Max level shown:
12024-08-30T19:45:01.820ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
22024-08-30T19:45:01.820ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32024-08-30T19:45:01.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42024-08-30T19:45:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52024-08-30T19:45:01.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62024-08-30T19:45:01.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72024-08-30T19:45:01.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82024-08-30T19:45:01.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92024-08-30T19:45:01.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.741558ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
102024-08-30T19:45:01.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112024-08-30T19:45:01.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122024-08-30T19:45:01.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132024-08-30T19:45:01.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142024-08-30T19:45:01.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152024-08-30T19:45:01.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
162024-08-30T19:45:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
172024-08-30T19:45:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
182024-08-30T19:45:01.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
192024-08-30T19:45:01.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
202024-08-30T19:45:01.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
212024-08-30T19:45:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
222024-08-30T19:45:01.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
232024-08-30T19:45:01.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
242024-08-30T19:45:01.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
252024-08-30T19:45:01.851ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
262024-08-30T19:45:01.851ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
272024-08-30T19:45:01.851ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
282024-08-30T19:45:01.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
292024-08-30T19:45:01.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
302024-08-30T19:45:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
312024-08-30T19:45:01.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
322024-08-30T19:45:01.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
332024-08-30T19:45:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
342024-08-30T19:45:01.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
352024-08-30T19:45:01.852ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
362024-08-30T19:45:01.853ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
372024-08-30T19:45:01.853ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.036097ms iteration = 3 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
382024-08-30T19:45:01.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
392024-08-30T19:45:01.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
402024-08-30T19:45:01.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
412024-08-30T19:45:01.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
422024-08-30T19:45:01.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
432024-08-30T19:45:01.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
442024-08-30T19:45:01.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
452024-08-30T19:45:01.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.195162ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
462024-08-30T19:45:01.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 988, tv_nsec: 164630431 } })
472024-08-30T19:45:01.856ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
482024-08-30T19:45:01.856ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
492024-08-30T19:45:01.856ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
502024-08-30T19:45:01.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
512024-08-30T19:45:01.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
522024-08-30T19:45:01.858ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
532024-08-30T19:45:01.858ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
542024-08-30T19:45:01.858ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.839769ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
552024-08-30T19:45:01.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
562024-08-30T19:45:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
572024-08-30T19:45:01.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
582024-08-30T19:45:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
592024-08-30T19:45:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
602024-08-30T19:45:01.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
612024-08-30T19:45:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
622024-08-30T19:45:01.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
632024-08-30T19:45:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
642024-08-30T19:45:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
652024-08-30T19:45:01.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
662024-08-30T19:45:01.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
672024-08-30T19:45:01.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
682024-08-30T19:45:01.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
692024-08-30T19:45:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
702024-08-30T19:45:01.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
712024-08-30T19:45:01.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
722024-08-30T19:45:01.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
732024-08-30T19:45:01.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
742024-08-30T19:45:01.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.500031ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
752024-08-30T19:45:01.883ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
762024-08-30T19:45:01.883ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
772024-08-30T19:45:01.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.57005ms iteration = 5 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
782024-08-30T19:45:01.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 118.786914ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
792024-08-30T19:45:01.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.660679ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
802024-08-30T19:45:01.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
812024-08-30T19:45:01.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 461afdaf-e66d-41fc-8b1e-0ebe17f0ba0c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
822024-08-30T19:45:01.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
832024-08-30T19:45:01.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 461afdaf-e66d-41fc-8b1e-0ebe17f0ba0c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
842024-08-30T19:45:01.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 461afdaf-e66d-41fc-8b1e-0ebe17f0ba0c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
852024-08-30T19:45:01.901ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
862024-08-30T19:45:01.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.226923ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
872024-08-30T19:45:01.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
882024-08-30T19:45:01.909ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
892024-08-30T19:45:01.909ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
902024-08-30T19:45:01.909ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.070068ms iteration = 8 status = {"physical_disks_added":0}
912024-08-30T19:45:01.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
922024-08-30T19:45:01.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
932024-08-30T19:45:01.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
942024-08-30T19:45:01.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
952024-08-30T19:45:01.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
962024-08-30T19:45:01.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
972024-08-30T19:45:01.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
982024-08-30T19:45:01.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
992024-08-30T19:45:01.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1002024-08-30T19:45:01.919ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
1012024-08-30T19:45:01.919ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
1022024-08-30T19:45:01.919ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-30 19:43:16.884603 UTC dns_group = internal generation = 1
1032024-08-30T19:45:01.919ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 151.175773ms iteration = 4 status = {"generation":1}
1042024-08-30T19:45:01.927ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-30T19:42:58.455639Z, time_modified: 2024-08-30T19:42:58.455639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
1052024-08-30T19:45:01.927ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 159.304415ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]}},"default_endpoint":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
1062024-08-30T19:45:01.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.642429ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1072024-08-30T19:45:01.949ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
1082024-08-30T19:45:01.949ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 0 version = 2
1092024-08-30T19:45:01.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1102024-08-30T19:45:01.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1112024-08-30T19:45:01.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1122024-08-30T19:45:01.954ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
1132024-08-30T19:45:01.954ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1142024-08-30T19:45:01.954ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1839ad8a-6696-42c6-8614-fce1eec33fb4", "content-length": "26", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} })
1152024-08-30T19:45:01.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1162024-08-30T19:45:01.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1172024-08-30T19:45:01.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1182024-08-30T19:45:01.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1192024-08-30T19:45:01.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1202024-08-30T19:45:01.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1212024-08-30T19:45:01.957ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1222024-08-30T19:45:01.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1232024-08-30T19:45:01.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1242024-08-30T19:45:02.027ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
1252024-08-30T19:45:02.027ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1262024-08-30T19:45:02.027ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "04a35b21-e228-4a12-95a2-16760c8a6116", "content-length": "26", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} })
1272024-08-30T19:45:02.027ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1282024-08-30T19:45:02.029ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
1292024-08-30T19:45:02.146ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1302024-08-30T19:45:02.149ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 1 version = 2
1312024-08-30T19:45:02.149ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
1322024-08-30T19:45:02.149ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-30 19:43:18.363870 UTC dns_group = external generation = 2
1332024-08-30T19:45:02.149ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 381.27928ms iteration = 4 status = {"generation":2}
1342024-08-30T19:45:02.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1352024-08-30T19:45:02.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1362024-08-30T19:45:02.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1372024-08-30T19:45:02.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1382024-08-30T19:45:02.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1392024-08-30T19:45:02.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1402024-08-30T19:45:02.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1412024-08-30T19:45:02.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1422024-08-30T19:45:02.178ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
1432024-08-30T19:45:02.178ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1442024-08-30T19:45:02.179ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "12e1c056-36ad-4c48-8bce-3170a0f99602", "content-length": "26", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} })
1452024-08-30T19:45:02.179ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1462024-08-30T19:45:02.181ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
1472024-08-30T19:45:02.181ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1482024-08-30T19:45:02.182ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
1492024-08-30T19:45:02.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1502024-08-30T19:45:02.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1512024-08-30T19:45:02.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 420.104382ms iteration = 5 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
1522024-08-30T19:45:02.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1532024-08-30T19:45:02.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1542024-08-30T19:45:02.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1552024-08-30T19:45:02.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
1562024-08-30T19:45:02.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1572024-08-30T19:45:02.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1582024-08-30T19:45:02.238ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 468.920598ms iteration = 5 status = 0
1592024-08-30T19:45:02.244ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 476.292018ms iteration = 5 status = {}
1602024-08-30T19:45:02.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa3a745b-ab43-4294-8d92-58f890576f35", "content-length": "372", "date": "Fri, 30 Aug 2024 19:45:02 GMT"} })
1612024-08-30T19:45:02.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1622024-08-30T19:45:02.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1632024-08-30T19:45:02.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1642024-08-30T19:45:02.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1652024-08-30T19:45:02.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1662024-08-30T19:45:02.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1672024-08-30T19:45:02.328ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1682024-08-30T19:45:02.328ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5fab5b20-edc7-4329-bbf2-4768b5713377", "content-length": "1", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} })
1692024-08-30T19:45:02.329ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1702024-08-30T19:45:02.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1712024-08-30T19:45:02.392ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
1722024-08-30T19:45:02.396ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1732024-08-30T19:45:02.399ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 630.582254ms iteration = 5 status = null
1742024-08-30T19:45:02.436ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
1752024-08-30T19:45:02.437ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d50d9cb6-dc9d-438a-84e7-65a496f473fd", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1762024-08-30T19:45:02.437ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1772024-08-30T19:45:02.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cb8cfee3-1b5d-4387-a1a7-7f34f54617f7", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1782024-08-30T19:45:02.438ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1792024-08-30T19:45:02.440ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1802024-08-30T19:45:02.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 672.012721ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
1812024-08-30T19:45:02.443ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
1822024-08-30T19:45:02.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1832024-08-30T19:45:02.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1842024-08-30T19:45:02.517ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
1852024-08-30T19:45:02.518ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "02d9d02d-44c5-49a7-b7b9-9a8d352c3644", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
1862024-08-30T19:45:02.518ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
1872024-08-30T19:45:02.519ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
1882024-08-30T19:45:02.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1892024-08-30T19:45:02.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1902024-08-30T19:45:02.519ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7da5cb1a-5616-46ac-8d83-8e3136432a6a", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
1912024-08-30T19:45:02.519ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
1922024-08-30T19:45:02.521ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "894ef3e9-5484-4a2d-8889-e960e591d751", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
1932024-08-30T19:45:02.521ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
1942024-08-30T19:45:02.523ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
1952024-08-30T19:45:02.523ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 754.860315ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
1962024-08-30T19:45:02.529ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ca586a9a-0549-4a6a-9572-f2121df2b369", "date": "Fri, 30 Aug 2024 19:45:02 GMT"} })
1972024-08-30T19:45:02.529ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "02724eeb-1ac1-4b19-92ea-f90d3a52e5b1", "content-length": "691", "date": "Fri, 30 Aug 2024 19:45:02 GMT"} })
1982024-08-30T19:45:02.529ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
1992024-08-30T19:45:02.529ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2002024-08-30T19:45:02.529ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2012024-08-30T19:45:02.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2022024-08-30T19:45:02.530ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 761.054854ms iteration = 6 status = {}
2032024-08-30T19:45:02.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bfef633e-129a-4a90-82ed-3761e52fa04f", "content-length": "121", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} })
2042024-08-30T19:45:02.531ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
2052024-08-30T19:45:02.531ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
2062024-08-30T19:45:02.531ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2072024-08-30T19:45:02.531ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2082024-08-30T19:45:02.531ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
2092024-08-30T19:45:02.531ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
2102024-08-30T19:45:02.531ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
2112024-08-30T19:45:02.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2122024-08-30T19:45:02.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2132024-08-30T19:45:02.532ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 762.616832ms iteration = 5 status = {}
2142024-08-30T19:45:02.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = fdf8bb0a-02f3-4e12-9c78-43c529032a84 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
2152024-08-30T19:45:02.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = fdf8bb0a-02f3-4e12-9c78-43c529032a84 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
2162024-08-30T19:45:02.547ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2172024-08-30T19:45:02.548ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e8623697-d0cd-4c33-929d-000b0becf511", "content-length": "2", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} })
2182024-08-30T19:45:02.548ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2192024-08-30T19:45:02.549ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6cdfa296-52f4-410e-a2d6-05b46b519fce", "content-length": "52", "date": "Fri, 30 Aug 2024 19:45:01 GMT"} })
2202024-08-30T19:45:02.549ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
2212024-08-30T19:45:02.549ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2222024-08-30T19:45:02.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = fdf8bb0a-02f3-4e12-9c78-43c529032a84 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
2232024-08-30T19:45:02.678ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a541816f-62dd-4f2f-800c-fdc7bb37352f", "date": "Fri, 30 Aug 2024 19:45:02 GMT"} })
2242024-08-30T19:45:02.678ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
2252024-08-30T19:45:02.678ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2262024-08-30T19:45:02.678ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97ad8c55-ea00-4391-980f-026f5f4bbd8e", "content-length": "667", "date": "Fri, 30 Aug 2024 19:45:02 GMT"} })
2272024-08-30T19:45:02.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2282024-08-30T19:45:02.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2292024-08-30T19:45:02.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2302024-08-30T19:45:02.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2312024-08-30T19:45:02.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2322024-08-30T19:45:02.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2332024-08-30T19:45:02.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2342024-08-30T19:45:02.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2352024-08-30T19:45:02.697ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 927.174059ms iteration = 5 status = {}
2362024-08-30T19:45:02.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e247c973-14c7-4705-bb09-fa73a14ad1f9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2372024-08-30T19:45:02.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e247c973-14c7-4705-bb09-fa73a14ad1f9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2382024-08-30T19:45:02.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e247c973-14c7-4705-bb09-fa73a14ad1f9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2392024-08-30T19:45:03.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2b5e622c-5cde-487e-ae4b-5fb27cb7ced5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2402024-08-30T19:45:03.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2b5e622c-5cde-487e-ae4b-5fb27cb7ced5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2412024-08-30T19:45:03.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2b5e622c-5cde-487e-ae4b-5fb27cb7ced5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2422024-08-30T19:45:04.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ded6cc63-0f48-415c-9ebb-4fb87d3957e5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2432024-08-30T19:45:04.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ded6cc63-0f48-415c-9ebb-4fb87d3957e5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2442024-08-30T19:45:04.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ded6cc63-0f48-415c-9ebb-4fb87d3957e5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2452024-08-30T19:45:05.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c3e66c74-c677-4fff-9224-a495df9e9b4d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2462024-08-30T19:45:05.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c3e66c74-c677-4fff-9224-a495df9e9b4d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2472024-08-30T19:45:06.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c3e66c74-c677-4fff-9224-a495df9e9b4d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2482024-08-30T19:45:07.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a1af9c37-3de0-45e0-9234-d948f7e6fcd5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2492024-08-30T19:45:07.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a1af9c37-3de0-45e0-9234-d948f7e6fcd5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2502024-08-30T19:45:07.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a1af9c37-3de0-45e0-9234-d948f7e6fcd5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2512024-08-30T19:45:08.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 50196f6e-524a-4f43-8c8f-7929ce910324 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2522024-08-30T19:45:08.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 50196f6e-524a-4f43-8c8f-7929ce910324 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2532024-08-30T19:45:08.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 50196f6e-524a-4f43-8c8f-7929ce910324 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2542024-08-30T19:45:09.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fc752c4d-4399-4732-9841-c8a742e6b9c8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2552024-08-30T19:45:09.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fc752c4d-4399-4732-9841-c8a742e6b9c8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2562024-08-30T19:45:09.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fc752c4d-4399-4732-9841-c8a742e6b9c8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2572024-08-30T19:45:10.019ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1392 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 77477b4a-d679-4bd0-8f48-811b628a5233 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
2582024-08-30T19:45:10.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fa9d22c5-c745-4316-a8a6-3247bf841c77 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2592024-08-30T19:45:10.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fa9d22c5-c745-4316-a8a6-3247bf841c77 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2602024-08-30T19:45:10.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fa9d22c5-c745-4316-a8a6-3247bf841c77 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2612024-08-30T19:45:11.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47df431b-8ea1-4290-a8a2-f20e6479e787 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2622024-08-30T19:45:11.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47df431b-8ea1-4290-a8a2-f20e6479e787 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2632024-08-30T19:45:11.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47df431b-8ea1-4290-a8a2-f20e6479e787 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2642024-08-30T19:45:11.769ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
2652024-08-30T19:45:11.769ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
2662024-08-30T19:45:11.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2672024-08-30T19:45:11.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2682024-08-30T19:45:11.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2692024-08-30T19:45:11.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2702024-08-30T19:45:11.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2712024-08-30T19:45:11.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2722024-08-30T19:45:11.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2732024-08-30T19:45:11.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2742024-08-30T19:45:11.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2752024-08-30T19:45:11.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2762024-08-30T19:45:11.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2772024-08-30T19:45:11.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
2782024-08-30T19:45:11.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2792024-08-30T19:45:11.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2802024-08-30T19:45:11.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
2812024-08-30T19:45:11.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.121625ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
2822024-08-30T19:45:11.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2832024-08-30T19:45:11.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2842024-08-30T19:45:11.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.156671ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2852024-08-30T19:45:12.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f0d822dc-701b-4ebc-8dcd-4dc0c2a0fad9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2862024-08-30T19:45:12.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f0d822dc-701b-4ebc-8dcd-4dc0c2a0fad9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2872024-08-30T19:45:12.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f0d822dc-701b-4ebc-8dcd-4dc0c2a0fad9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2882024-08-30T19:45:13.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 457c87f8-761d-432f-94ca-dbc1aae127d7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2892024-08-30T19:45:13.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 457c87f8-761d-432f-94ca-dbc1aae127d7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2902024-08-30T19:45:13.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 457c87f8-761d-432f-94ca-dbc1aae127d7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2912024-08-30T19:45:14.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 82018c67-832a-4bf9-957b-593e33b50089 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2922024-08-30T19:45:14.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 82018c67-832a-4bf9-957b-593e33b50089 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2932024-08-30T19:45:14.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 82018c67-832a-4bf9-957b-593e33b50089 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2942024-08-30T19:45:15.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1a4b2734-57e8-4372-8651-9d14fd836465 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2952024-08-30T19:45:15.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1a4b2734-57e8-4372-8651-9d14fd836465 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2962024-08-30T19:45:15.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1a4b2734-57e8-4372-8651-9d14fd836465 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2972024-08-30T19:45:16.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = af6518bc-2eef-4b1a-8be1-c2340a8eddd7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2982024-08-30T19:45:16.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = af6518bc-2eef-4b1a-8be1-c2340a8eddd7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
2992024-08-30T19:45:16.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = af6518bc-2eef-4b1a-8be1-c2340a8eddd7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3002024-08-30T19:45:17.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d09335bf-aba5-49b5-9be1-226d575ff728 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3012024-08-30T19:45:17.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d09335bf-aba5-49b5-9be1-226d575ff728 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3022024-08-30T19:45:17.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d09335bf-aba5-49b5-9be1-226d575ff728 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3032024-08-30T19:45:18.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c3314931-3638-49c5-9fe6-1388e2d3ba0e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3042024-08-30T19:45:18.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c3314931-3638-49c5-9fe6-1388e2d3ba0e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3052024-08-30T19:45:18.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c3314931-3638-49c5-9fe6-1388e2d3ba0e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3062024-08-30T19:45:19.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0e9d3969-098e-4d26-855e-56eeb51acbc1 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3072024-08-30T19:45:19.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0e9d3969-098e-4d26-855e-56eeb51acbc1 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3082024-08-30T19:45:19.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0e9d3969-098e-4d26-855e-56eeb51acbc1 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3092024-08-30T19:45:20.019ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1366 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 61eda7c7-f508-4efc-857f-9d67e897b292 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
3102024-08-30T19:45:20.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d295d77-2939-4229-b330-e268f0b7b690 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3112024-08-30T19:45:20.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d295d77-2939-4229-b330-e268f0b7b690 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3122024-08-30T19:45:20.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d295d77-2939-4229-b330-e268f0b7b690 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3132024-08-30T19:45:21.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e1491aa0-5593-4e3a-849b-9acd594a1f97 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3142024-08-30T19:45:21.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e1491aa0-5593-4e3a-849b-9acd594a1f97 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3152024-08-30T19:45:21.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e1491aa0-5593-4e3a-849b-9acd594a1f97 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3162024-08-30T19:45:21.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
3172024-08-30T19:45:21.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
3182024-08-30T19:45:21.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3192024-08-30T19:45:21.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3202024-08-30T19:45:21.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3212024-08-30T19:45:21.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3222024-08-30T19:45:21.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3232024-08-30T19:45:21.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3242024-08-30T19:45:21.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.112542ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3252024-08-30T19:45:21.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3262024-08-30T19:45:21.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3272024-08-30T19:45:21.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3282024-08-30T19:45:21.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3292024-08-30T19:45:21.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3302024-08-30T19:45:21.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3312024-08-30T19:45:21.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3322024-08-30T19:45:21.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
3332024-08-30T19:45:21.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3342024-08-30T19:45:21.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3352024-08-30T19:45:21.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
3362024-08-30T19:45:21.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.53014ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
3372024-08-30T19:45:22.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bd0154c8-362c-44dd-8c1d-2f7aea993d40 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3382024-08-30T19:45:22.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bd0154c8-362c-44dd-8c1d-2f7aea993d40 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3392024-08-30T19:45:22.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bd0154c8-362c-44dd-8c1d-2f7aea993d40 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3402024-08-30T19:45:23.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41d84a12-975f-4be8-acc3-b6b72b6d86e6 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3412024-08-30T19:45:23.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41d84a12-975f-4be8-acc3-b6b72b6d86e6 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3422024-08-30T19:45:23.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41d84a12-975f-4be8-acc3-b6b72b6d86e6 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3432024-08-30T19:45:24.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e32c4906-040d-454c-a91a-3521b660bca0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3442024-08-30T19:45:24.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e32c4906-040d-454c-a91a-3521b660bca0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3452024-08-30T19:45:24.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e32c4906-040d-454c-a91a-3521b660bca0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3462024-08-30T19:45:25.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 46a17648-4f95-45e9-b9fa-08791eeb3f4c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3472024-08-30T19:45:25.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 46a17648-4f95-45e9-b9fa-08791eeb3f4c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3482024-08-30T19:45:25.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 46a17648-4f95-45e9-b9fa-08791eeb3f4c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3492024-08-30T19:45:26.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9b662419-f03a-4c82-8b77-e841c500dea6 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3502024-08-30T19:45:26.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9b662419-f03a-4c82-8b77-e841c500dea6 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3512024-08-30T19:45:26.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9b662419-f03a-4c82-8b77-e841c500dea6 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3522024-08-30T19:45:27.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ff1ae12d-30f6-4498-af7f-506d611d39a4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3532024-08-30T19:45:27.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ff1ae12d-30f6-4498-af7f-506d611d39a4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3542024-08-30T19:45:27.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ff1ae12d-30f6-4498-af7f-506d611d39a4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3552024-08-30T19:45:28.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 66310777-1e82-45ee-9bdc-7a0efdff86ed roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3562024-08-30T19:45:28.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 66310777-1e82-45ee-9bdc-7a0efdff86ed resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3572024-08-30T19:45:28.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 66310777-1e82-45ee-9bdc-7a0efdff86ed response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3582024-08-30T19:45:29.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c51fa2d-3a61-4375-9bf0-a93c09ffdf6f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3592024-08-30T19:45:29.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c51fa2d-3a61-4375-9bf0-a93c09ffdf6f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3602024-08-30T19:45:29.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c51fa2d-3a61-4375-9bf0-a93c09ffdf6f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3612024-08-30T19:45:30.020ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1373 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 26297d37-e1cb-43f1-a305-537266a41125 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
3622024-08-30T19:45:30.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a0161c56-7606-44c7-91b4-7efadad68845 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3632024-08-30T19:45:30.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a0161c56-7606-44c7-91b4-7efadad68845 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3642024-08-30T19:45:30.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a0161c56-7606-44c7-91b4-7efadad68845 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3652024-08-30T19:45:31.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5fc8519b-4842-4aa7-9090-8b393ab8b65a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3662024-08-30T19:45:31.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5fc8519b-4842-4aa7-9090-8b393ab8b65a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3672024-08-30T19:45:31.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5fc8519b-4842-4aa7-9090-8b393ab8b65a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
3682024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
3692024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
3702024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3712024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
3722024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3732024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
3742024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3752024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
3762024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
3772024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
3782024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
3792024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3802024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3812024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
3822024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3832024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3842024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3852024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
3862024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3872024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
3882024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3892024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
3902024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3912024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
3922024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
3932024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
3942024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
3952024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
3962024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3972024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3982024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
3992024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4002024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
4012024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4022024-08-30T19:45:31.769ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
4032024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4042024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4052024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4062024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4072024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4082024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4092024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4102024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4112024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4122024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4132024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4142024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4152024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4162024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4172024-08-30T19:45:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4182024-08-30T19:45:31.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4192024-08-30T19:45:31.773ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.064282ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4202024-08-30T19:45:31.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1018, tv_nsec: 81479182 } })
4212024-08-30T19:45:31.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1018, tv_nsec: 81706706 } })
4222024-08-30T19:45:31.774ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
4232024-08-30T19:45:31.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
4242024-08-30T19:45:31.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4252024-08-30T19:45:31.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4262024-08-30T19:45:31.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4272024-08-30T19:45:31.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4282024-08-30T19:45:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
4292024-08-30T19:45:31.784ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4302024-08-30T19:45:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4312024-08-30T19:45:31.789ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1018, tv_nsec: 97200448 } })
4322024-08-30T19:45:31.789ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
4332024-08-30T19:45:31.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4342024-08-30T19:45:31.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
4352024-08-30T19:45:31.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4362024-08-30T19:45:31.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4372024-08-30T19:45:31.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4382024-08-30T19:45:31.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4392024-08-30T19:45:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4402024-08-30T19:45:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4412024-08-30T19:45:31.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4422024-08-30T19:45:31.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.241939ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
4432024-08-30T19:45:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4442024-08-30T19:45:31.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4452024-08-30T19:45:31.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4462024-08-30T19:45:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4472024-08-30T19:45:31.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4482024-08-30T19:45:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4492024-08-30T19:45:31.825ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
4502024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4512024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4522024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4532024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4542024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4552024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4562024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4572024-08-30T19:45:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4582024-08-30T19:45:31.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.193554ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
4592024-08-30T19:45:31.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4602024-08-30T19:45:31.828ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4612024-08-30T19:45:31.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4622024-08-30T19:45:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4632024-08-30T19:45:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
4642024-08-30T19:45:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4652024-08-30T19:45:31.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4662024-08-30T19:45:31.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4672024-08-30T19:45:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4682024-08-30T19:45:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4692024-08-30T19:45:31.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4702024-08-30T19:45:31.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4712024-08-30T19:45:31.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4722024-08-30T19:45:31.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4732024-08-30T19:45:31.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
4742024-08-30T19:45:31.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.566904ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
4752024-08-30T19:45:31.856ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
4762024-08-30T19:45:31.856ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4772024-08-30T19:45:31.856ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.658311ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
4782024-08-30T19:45:31.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4792024-08-30T19:45:31.864ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4802024-08-30T19:45:31.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.941586ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4812024-08-30T19:45:31.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4822024-08-30T19:45:31.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4832024-08-30T19:45:31.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4842024-08-30T19:45:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4852024-08-30T19:45:31.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.99179ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
4862024-08-30T19:45:31.868ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
4872024-08-30T19:45:31.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.461437ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
4882024-08-30T19:45:31.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4892024-08-30T19:45:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4902024-08-30T19:45:31.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4912024-08-30T19:45:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4922024-08-30T19:45:31.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.213841ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4932024-08-30T19:45:31.878ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
4942024-08-30T19:45:31.878ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4952024-08-30T19:45:31.879ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e8978f5-f52d-4243-93ef-edd790a176e5", "content-length": "26", "date": "Fri, 30 Aug 2024 19:45:31 GMT"} })
4962024-08-30T19:45:31.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4972024-08-30T19:45:31.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4982024-08-30T19:45:31.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4992024-08-30T19:45:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5002024-08-30T19:45:31.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.097525ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5012024-08-30T19:45:31.912ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.126202ms iteration = 9 status = {"physical_disks_added":0}
5022024-08-30T19:45:31.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5032024-08-30T19:45:31.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5042024-08-30T19:45:31.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5052024-08-30T19:45:31.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5062024-08-30T19:45:31.978ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5072024-08-30T19:45:31.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5082024-08-30T19:45:31.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5092024-08-30T19:45:31.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5102024-08-30T19:45:31.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5112024-08-30T19:45:31.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5122024-08-30T19:45:31.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5132024-08-30T19:45:31.984ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5142024-08-30T19:45:31.985ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5dbcef-5dbd-42a0-b27b-c512f90ca4ad", "content-length": "26", "date": "Fri, 30 Aug 2024 19:45:31 GMT"} })
5152024-08-30T19:45:31.985ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5162024-08-30T19:45:31.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5172024-08-30T19:45:32.002ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 233.375555ms iteration = 6 status = {}
5182024-08-30T19:45:32.004ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
5192024-08-30T19:45:32.004ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5202024-08-30T19:45:32.004ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f7274f0-fc6b-4f08-a539-71b97efc1e0d", "content-length": "26", "date": "Fri, 30 Aug 2024 19:45:31 GMT"} })
5212024-08-30T19:45:32.004ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5222024-08-30T19:45:32.006ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
5232024-08-30T19:45:32.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5242024-08-30T19:45:32.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5252024-08-30T19:45:32.074ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5262024-08-30T19:45:32.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "72e01f4f-3a86-466e-8560-df6bbe4ebf29", "content-length": "372", "date": "Fri, 30 Aug 2024 19:45:32 GMT"} })
5272024-08-30T19:45:32.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5282024-08-30T19:45:32.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5292024-08-30T19:45:32.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5302024-08-30T19:45:32.077ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
5312024-08-30T19:45:32.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5322024-08-30T19:45:32.077ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1035d035-296f-4114-bce3-61cff2edd69f", "content-length": "1", "date": "Fri, 30 Aug 2024 19:45:31 GMT"} })
5332024-08-30T19:45:32.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5342024-08-30T19:45:32.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5352024-08-30T19:45:32.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5362024-08-30T19:45:32.079ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5372024-08-30T19:45:32.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5382024-08-30T19:45:32.081ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 311.843182ms iteration = 6 status = null
5392024-08-30T19:45:32.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
5402024-08-30T19:45:32.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5412024-08-30T19:45:32.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5422024-08-30T19:45:32.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5432024-08-30T19:45:32.083ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 313.507551ms iteration = 6 status = 0
5442024-08-30T19:45:32.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5452024-08-30T19:45:32.084ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5462024-08-30T19:45:32.087ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9088f0e2-79d8-4026-80b3-dd08a197e23b", "date": "Fri, 30 Aug 2024 19:45:32 GMT"} })
5472024-08-30T19:45:32.088ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 318.946607ms iteration = 7 status = {}
5482024-08-30T19:45:32.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5492024-08-30T19:45:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5502024-08-30T19:45:32.178ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5512024-08-30T19:45:32.179ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c579798-6099-4f9b-bb40-ef9958a6d259", "content-length": "691", "date": "Fri, 30 Aug 2024 19:45:32 GMT"} })
5522024-08-30T19:45:32.179ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
5532024-08-30T19:45:32.179ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
5542024-08-30T19:45:32.179ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
5552024-08-30T19:45:32.179ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
5562024-08-30T19:45:32.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5572024-08-30T19:45:32.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5582024-08-30T19:45:32.180ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 410.765098ms iteration = 6 status = {}
5592024-08-30T19:45:32.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5602024-08-30T19:45:32.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cc7a595b-f824-4630-8772-75d7fe1f3151", "content-length": "121", "date": "Fri, 30 Aug 2024 19:45:31 GMT"} })
5612024-08-30T19:45:32.188ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
5622024-08-30T19:45:32.188ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
5632024-08-30T19:45:32.188ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5642024-08-30T19:45:32.188ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5652024-08-30T19:45:32.188ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
5662024-08-30T19:45:32.188ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
5672024-08-30T19:45:32.188ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
5682024-08-30T19:45:32.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5692024-08-30T19:45:32.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5702024-08-30T19:45:32.190ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5712024-08-30T19:45:32.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c395b50e-d44c-4da6-ba69-5e2242462ae4", "content-length": "2", "date": "Fri, 30 Aug 2024 19:45:31 GMT"} })
5722024-08-30T19:45:32.190ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5732024-08-30T19:45:32.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a10de8dc-fb58-4716-b09c-732572616365", "content-length": "52", "date": "Fri, 30 Aug 2024 19:45:31 GMT"} })
5742024-08-30T19:45:32.190ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
5752024-08-30T19:45:32.190ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5762024-08-30T19:45:32.275ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bab1acd3-7dc7-4944-b05b-040373281ae5", "date": "Fri, 30 Aug 2024 19:45:32 GMT"} })
5772024-08-30T19:45:32.275ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
5782024-08-30T19:45:32.275ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5792024-08-30T19:45:32.275ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d22ea5a5-7d40-4d2e-9a80-6a74d5e00d4d", "content-length": "667", "date": "Fri, 30 Aug 2024 19:45:32 GMT"} })
5802024-08-30T19:45:32.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5812024-08-30T19:45:32.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5822024-08-30T19:45:32.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5832024-08-30T19:45:32.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5842024-08-30T19:45:32.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5852024-08-30T19:45:32.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5862024-08-30T19:45:32.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5872024-08-30T19:45:32.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5882024-08-30T19:45:32.387ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 617.396534ms iteration = 6 status = {}
5892024-08-30T19:45:32.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3a547535-0ab0-4f54-a4f5-507f164863fa roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
5902024-08-30T19:45:32.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3a547535-0ab0-4f54-a4f5-507f164863fa resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
5912024-08-30T19:45:32.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3a547535-0ab0-4f54-a4f5-507f164863fa response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
5922024-08-30T19:45:32.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 80e592ab-cf7d-47a6-a84f-4b9f5779352b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
5932024-08-30T19:45:32.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 80e592ab-cf7d-47a6-a84f-4b9f5779352b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
5942024-08-30T19:45:32.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 80e592ab-cf7d-47a6-a84f-4b9f5779352b response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
5952024-08-30T19:45:33.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0eb0eb2b-9e2b-4eaf-9d31-57cca561970f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
5962024-08-30T19:45:33.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0eb0eb2b-9e2b-4eaf-9d31-57cca561970f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
5972024-08-30T19:45:33.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0eb0eb2b-9e2b-4eaf-9d31-57cca561970f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
5982024-08-30T19:45:34.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5964ec7f-379d-41f4-9ecf-eab4ee30df6b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
5992024-08-30T19:45:34.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5964ec7f-379d-41f4-9ecf-eab4ee30df6b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6002024-08-30T19:45:34.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5964ec7f-379d-41f4-9ecf-eab4ee30df6b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6012024-08-30T19:45:35.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd4686f2-8dfd-4d2e-9337-10359a718573 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6022024-08-30T19:45:35.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd4686f2-8dfd-4d2e-9337-10359a718573 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6032024-08-30T19:45:35.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd4686f2-8dfd-4d2e-9337-10359a718573 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6042024-08-30T19:45:36.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2df7dadc-d992-4766-9c8f-4fdf701836e3 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6052024-08-30T19:45:36.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2df7dadc-d992-4766-9c8f-4fdf701836e3 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6062024-08-30T19:45:36.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2df7dadc-d992-4766-9c8f-4fdf701836e3 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6072024-08-30T19:45:37.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = da40f4a6-4b6c-4af2-9819-80665ea57da3 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6082024-08-30T19:45:37.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = da40f4a6-4b6c-4af2-9819-80665ea57da3 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6092024-08-30T19:45:37.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = da40f4a6-4b6c-4af2-9819-80665ea57da3 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6102024-08-30T19:45:38.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6e06abc2-579b-40b6-88a7-adc2cc206f8b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6112024-08-30T19:45:38.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6e06abc2-579b-40b6-88a7-adc2cc206f8b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6122024-08-30T19:45:38.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6e06abc2-579b-40b6-88a7-adc2cc206f8b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6132024-08-30T19:45:39.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 61df1380-fe0a-422c-8d33-d3e5d6827a32 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6142024-08-30T19:45:39.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 61df1380-fe0a-422c-8d33-d3e5d6827a32 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6152024-08-30T19:45:39.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 61df1380-fe0a-422c-8d33-d3e5d6827a32 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6162024-08-30T19:45:40.019ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 97602ef8-05d9-43e4-a5e2-e7f1e9e78d87 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
6172024-08-30T19:45:40.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 366e6653-e70f-4785-a187-b935bba0ca00 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6182024-08-30T19:45:40.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 366e6653-e70f-4785-a187-b935bba0ca00 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6192024-08-30T19:45:40.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 366e6653-e70f-4785-a187-b935bba0ca00 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6202024-08-30T19:45:41.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
6212024-08-30T19:45:41.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
6222024-08-30T19:45:41.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6232024-08-30T19:45:41.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6242024-08-30T19:45:41.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6252024-08-30T19:45:41.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6262024-08-30T19:45:41.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6272024-08-30T19:45:41.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6282024-08-30T19:45:41.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292024-08-30T19:45:41.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.95465ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6302024-08-30T19:45:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6312024-08-30T19:45:41.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6322024-08-30T19:45:41.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6332024-08-30T19:45:41.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a71a17e7-a9ef-4553-bb7c-4f0e4dc75f98 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6342024-08-30T19:45:41.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a71a17e7-a9ef-4553-bb7c-4f0e4dc75f98 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6352024-08-30T19:45:41.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6362024-08-30T19:45:41.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6372024-08-30T19:45:41.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a71a17e7-a9ef-4553-bb7c-4f0e4dc75f98 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6382024-08-30T19:45:41.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6392024-08-30T19:45:41.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
6402024-08-30T19:45:41.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6412024-08-30T19:45:41.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6422024-08-30T19:45:41.790ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
6432024-08-30T19:45:41.790ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.856738ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
6442024-08-30T19:45:42.202ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36222
6452024-08-30T19:45:42.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36222 req_id = 7ac9b25b-aca6-4952-9cf7-0a6070cd659e roles = RoleSet { roles: {} } uri = /metrics/producers
6462024-08-30T19:45:42.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36222 req_id = 7ac9b25b-aca6-4952-9cf7-0a6070cd659e resource = Database result = Ok(()) uri = /metrics/producers
6472024-08-30T19:45:42.235ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
6482024-08-30T19:45:42.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36222 req_id = 7ac9b25b-aca6-4952-9cf7-0a6070cd659e roles = RoleSet { roles: {} } uri = /metrics/producers
6492024-08-30T19:45:42.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36222 req_id = 7ac9b25b-aca6-4952-9cf7-0a6070cd659e resource = Database result = Ok(()) uri = /metrics/producers
6502024-08-30T19:45:42.273ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
6512024-08-30T19:45:42.273ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "31d03813-d479-44eb-8986-79a9d09734f5", "date": "Fri, 30 Aug 2024 19:45:42 GMT"} })
6522024-08-30T19:45:42.273ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 1a27df0f-5b46-452b-9341-ffa1d189a587
6532024-08-30T19:45:42.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 72567 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36222 req_id = 7ac9b25b-aca6-4952-9cf7-0a6070cd659e response_code = 201 uri = /metrics/producers
6542024-08-30T19:45:42.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 19eb91df-2daa-4cc3-b59c-8fe63549aebf roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6552024-08-30T19:45:42.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 19eb91df-2daa-4cc3-b59c-8fe63549aebf resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6562024-08-30T19:45:42.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 19eb91df-2daa-4cc3-b59c-8fe63549aebf response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6572024-08-30T19:45:43.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2dea17d7-168e-425e-8a51-07ac4f5d3a0e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6582024-08-30T19:45:43.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2dea17d7-168e-425e-8a51-07ac4f5d3a0e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6592024-08-30T19:45:43.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2dea17d7-168e-425e-8a51-07ac4f5d3a0e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6602024-08-30T19:45:44.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd517d75-cd6f-42bc-9f2d-7679598aa906 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6612024-08-30T19:45:44.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd517d75-cd6f-42bc-9f2d-7679598aa906 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6622024-08-30T19:45:44.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd517d75-cd6f-42bc-9f2d-7679598aa906 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6632024-08-30T19:45:45.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 44964aa4-a32b-4af8-9e9e-7bbdab258120 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6642024-08-30T19:45:45.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 44964aa4-a32b-4af8-9e9e-7bbdab258120 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6652024-08-30T19:45:45.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 44964aa4-a32b-4af8-9e9e-7bbdab258120 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6662024-08-30T19:45:46.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad86766f-6afd-4285-b7ed-207f34b1ffb8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6672024-08-30T19:45:46.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad86766f-6afd-4285-b7ed-207f34b1ffb8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6682024-08-30T19:45:46.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad86766f-6afd-4285-b7ed-207f34b1ffb8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6692024-08-30T19:45:47.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2cd8b4ad-54ac-47a9-bfa4-ff9cc57c5040 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6702024-08-30T19:45:47.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2cd8b4ad-54ac-47a9-bfa4-ff9cc57c5040 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6712024-08-30T19:45:47.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2cd8b4ad-54ac-47a9-bfa4-ff9cc57c5040 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6722024-08-30T19:45:48.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c37bd501-0eef-48ee-8005-495d5cf01a1d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6732024-08-30T19:45:48.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c37bd501-0eef-48ee-8005-495d5cf01a1d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6742024-08-30T19:45:48.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c37bd501-0eef-48ee-8005-495d5cf01a1d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6752024-08-30T19:45:49.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fce1ff5a-7f26-4ea8-b90f-349aceb2b021 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6762024-08-30T19:45:49.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fce1ff5a-7f26-4ea8-b90f-349aceb2b021 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6772024-08-30T19:45:49.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fce1ff5a-7f26-4ea8-b90f-349aceb2b021 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6782024-08-30T19:45:49.990ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
6792024-08-30T19:45:49.990ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
6802024-08-30T19:45:50.020ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
6812024-08-30T19:45:50.020ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:59670
6822024-08-30T19:45:50.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59670 req_id = f448a5f3-6a30-4556-8a73-594612ba2673 roles = RoleSet { roles: {} } uri = /metrics/producers
6832024-08-30T19:45:50.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59670 req_id = f448a5f3-6a30-4556-8a73-594612ba2673 resource = Database result = Ok(()) uri = /metrics/producers
6842024-08-30T19:45:50.022ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1275 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = dade9022-a416-4b50-8548-c5675fd59474 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
6852024-08-30T19:45:50.055ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
6862024-08-30T19:45:50.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59670 req_id = f448a5f3-6a30-4556-8a73-594612ba2673 roles = RoleSet { roles: {} } uri = /metrics/producers
6872024-08-30T19:45:50.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59670 req_id = f448a5f3-6a30-4556-8a73-594612ba2673 resource = Database result = Ok(()) uri = /metrics/producers
6882024-08-30T19:45:50.062ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
6892024-08-30T19:45:50.063ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2cd79eed-5288-43ce-9bcd-48ff1d7a7402", "date": "Fri, 30 Aug 2024 19:45:50 GMT"} })
6902024-08-30T19:45:50.063ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
6912024-08-30T19:45:50.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44233 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59670 req_id = f448a5f3-6a30-4556-8a73-594612ba2673 response_code = 201 uri = /metrics/producers
6922024-08-30T19:45:50.065ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "f448a5f3-6a30-4556-8a73-594612ba2673", "content-length": "41", "date": "Fri, 30 Aug 2024 19:45:50 GMT"} })
6932024-08-30T19:45:50.066ZDEBGnexus (producer-registration-task): registered with nexus successfully
6942024-08-30T19:45:50.066ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
6952024-08-30T19:45:50.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0c6e8ed8-821a-4ef2-bf6a-262da94f99b9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6962024-08-30T19:45:50.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0c6e8ed8-821a-4ef2-bf6a-262da94f99b9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6972024-08-30T19:45:50.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0c6e8ed8-821a-4ef2-bf6a-262da94f99b9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
6982024-08-30T19:45:51.287ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56161
6992024-08-30T19:45:51.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56161 req_id = 31419de5-ac3c-4233-9d44-713015ed53c8 roles = RoleSet { roles: {} } uri = /metrics/producers
7002024-08-30T19:45:51.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56161 req_id = 31419de5-ac3c-4233-9d44-713015ed53c8 resource = Database result = Ok(()) uri = /metrics/producers
7012024-08-30T19:45:51.329ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
7022024-08-30T19:45:51.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56161 req_id = 31419de5-ac3c-4233-9d44-713015ed53c8 roles = RoleSet { roles: {} } uri = /metrics/producers
7032024-08-30T19:45:51.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56161 req_id = 31419de5-ac3c-4233-9d44-713015ed53c8 resource = Database result = Ok(()) uri = /metrics/producers
7042024-08-30T19:45:51.413ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
7052024-08-30T19:45:51.413ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c705e8f5-133d-4c7a-ade9-20b57a727633", "date": "Fri, 30 Aug 2024 19:45:51 GMT"} })
7062024-08-30T19:45:51.413ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 97bafd33-1efa-47dd-ad8d-79adc978f835
7072024-08-30T19:45:51.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 126881 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56161 req_id = 31419de5-ac3c-4233-9d44-713015ed53c8 response_code = 201 uri = /metrics/producers
7082024-08-30T19:45:51.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
7092024-08-30T19:45:51.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
7102024-08-30T19:45:51.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7112024-08-30T19:45:51.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7122024-08-30T19:45:51.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7132024-08-30T19:45:51.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7142024-08-30T19:45:51.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152024-08-30T19:45:51.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7162024-08-30T19:45:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7172024-08-30T19:45:51.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.153673ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7182024-08-30T19:45:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7192024-08-30T19:45:51.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7202024-08-30T19:45:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7212024-08-30T19:45:51.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7222024-08-30T19:45:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7232024-08-30T19:45:51.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7242024-08-30T19:45:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
7252024-08-30T19:45:51.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7262024-08-30T19:45:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7272024-08-30T19:45:51.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
7282024-08-30T19:45:51.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.849091ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
7292024-08-30T19:45:51.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 14453b60-6961-463a-9963-f1aca9ee1f07 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7302024-08-30T19:45:51.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 14453b60-6961-463a-9963-f1aca9ee1f07 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7312024-08-30T19:45:52.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 14453b60-6961-463a-9963-f1aca9ee1f07 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7322024-08-30T19:45:53.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 91ae23cb-a090-4981-b6e1-5c73221a1b31 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7332024-08-30T19:45:53.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 91ae23cb-a090-4981-b6e1-5c73221a1b31 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7342024-08-30T19:45:53.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 91ae23cb-a090-4981-b6e1-5c73221a1b31 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7352024-08-30T19:45:53.841ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48722
7362024-08-30T19:45:53.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48722 req_id = 665fee6c-9a8d-4aed-83ef-c0dbd841e9cc roles = RoleSet { roles: {} } uri = /metrics/producers
7372024-08-30T19:45:53.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48722 req_id = 665fee6c-9a8d-4aed-83ef-c0dbd841e9cc resource = Database result = Ok(()) uri = /metrics/producers
7382024-08-30T19:45:53.874ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
7392024-08-30T19:45:53.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48722 req_id = 665fee6c-9a8d-4aed-83ef-c0dbd841e9cc roles = RoleSet { roles: {} } uri = /metrics/producers
7402024-08-30T19:45:53.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48722 req_id = 665fee6c-9a8d-4aed-83ef-c0dbd841e9cc resource = Database result = Ok(()) uri = /metrics/producers
7412024-08-30T19:45:53.891ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
7422024-08-30T19:45:53.891ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f6572ecc-6428-4e2e-a525-05ffe6f3927b", "date": "Fri, 30 Aug 2024 19:45:53 GMT"} })
7432024-08-30T19:45:53.891ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = ed7080f3-1d98-4020-99f0-be3df73052de
7442024-08-30T19:45:53.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51263 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48722 req_id = 665fee6c-9a8d-4aed-83ef-c0dbd841e9cc response_code = 201 uri = /metrics/producers
7452024-08-30T19:45:54.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 79a830b3-a290-4906-9f4e-76c62f75d092 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7462024-08-30T19:45:54.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 79a830b3-a290-4906-9f4e-76c62f75d092 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7472024-08-30T19:45:54.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 79a830b3-a290-4906-9f4e-76c62f75d092 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7482024-08-30T19:45:55.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3dcc65bf-a4d0-4d8a-bff2-94f5b06d8c9c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7492024-08-30T19:45:55.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3dcc65bf-a4d0-4d8a-bff2-94f5b06d8c9c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7502024-08-30T19:45:55.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3dcc65bf-a4d0-4d8a-bff2-94f5b06d8c9c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7512024-08-30T19:45:56.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e4a0c13-1701-4223-9170-99ede0e0d028 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7522024-08-30T19:45:56.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e4a0c13-1701-4223-9170-99ede0e0d028 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7532024-08-30T19:45:56.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e4a0c13-1701-4223-9170-99ede0e0d028 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7542024-08-30T19:45:57.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f017889a-3428-4d60-ab9e-b821edd383ee roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7552024-08-30T19:45:57.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f017889a-3428-4d60-ab9e-b821edd383ee resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7562024-08-30T19:45:57.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f017889a-3428-4d60-ab9e-b821edd383ee response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7572024-08-30T19:45:58.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41545790-ba58-4181-9862-28b76a22e1d1 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7582024-08-30T19:45:58.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41545790-ba58-4181-9862-28b76a22e1d1 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7592024-08-30T19:45:58.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41545790-ba58-4181-9862-28b76a22e1d1 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7602024-08-30T19:45:59.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8056ee13-6c22-41e0-aefe-991df60a04d4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7612024-08-30T19:45:59.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8056ee13-6c22-41e0-aefe-991df60a04d4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7622024-08-30T19:45:59.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8056ee13-6c22-41e0-aefe-991df60a04d4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7632024-08-30T19:46:00.066ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1451 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 58069853-500f-4c43-904d-fdcea5b17900 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
7642024-08-30T19:46:00.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47020342-e9ea-44cd-be72-fa2f69691d43 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7652024-08-30T19:46:00.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47020342-e9ea-44cd-be72-fa2f69691d43 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7662024-08-30T19:46:00.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47020342-e9ea-44cd-be72-fa2f69691d43 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7672024-08-30T19:46:01.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b4491dbc-235d-4278-ad34-30a4058d84b5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7682024-08-30T19:46:01.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b4491dbc-235d-4278-ad34-30a4058d84b5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7692024-08-30T19:46:01.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b4491dbc-235d-4278-ad34-30a4058d84b5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
7702024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
7712024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7722024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
7732024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
7742024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
7752024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
7762024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7772024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
7782024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
7792024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
7802024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7812024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
7822024-08-30T19:46:01.769ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-30 19:36:01.769780502 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
7832024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
7842024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
7852024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7862024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
7872024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
7882024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7892024-08-30T19:46:01.769ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
7902024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7912024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7922024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7932024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7942024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7952024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
7962024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
7972024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
7982024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7992024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8002024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
8012024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8022024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
8032024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
8042024-08-30T19:46:01.770ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25
8052024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8062024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.27\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25"}
8072024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
8082024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
8092024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8102024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
8112024-08-30T19:46:01.770ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
8122024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
8132024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8142024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8152024-08-30T19:46:01.770ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
8162024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8172024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
8182024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
8192024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8202024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8212024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
8222024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8232024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
8242024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
8252024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8262024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8272024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
8282024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8292024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
8302024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8312024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
8322024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8332024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
8342024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8352024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8362024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
8372024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8382024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8392024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8402024-08-30T19:46:01.770ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8b642bba-10a6-428b-9af7-48d5f8622e03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5d7b957-0082-4dc3-b742-d6e7150a43c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1048, tv_nsec: 78099212 } })
8412024-08-30T19:46:01.770ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5636b10-76ec-4aa4-8bd4-1f95780813df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1048, tv_nsec: 78111593 } })
8422024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8432024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8442024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
8452024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8462024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8472024-08-30T19:46:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8482024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
8492024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8502024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8512024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8522024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8532024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8542024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8552024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8562024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8572024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8582024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8592024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8602024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8612024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8622024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8632024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8642024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8652024-08-30T19:46:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8662024-08-30T19:46:01.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8672024-08-30T19:46:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8682024-08-30T19:46:01.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8692024-08-30T19:46:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8702024-08-30T19:46:01.773ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.117852ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8712024-08-30T19:46:01.774ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
8722024-08-30T19:46:01.774ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.481279ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
8732024-08-30T19:46:01.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8742024-08-30T19:46:01.775ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
8752024-08-30T19:46:01.775ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.637419ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
8762024-08-30T19:46:01.775ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1048, tv_nsec: 82794055 } })
8772024-08-30T19:46:01.775ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1048, tv_nsec: 82821805 } })
8782024-08-30T19:46:01.775ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-30 19:36:01.769780502 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
8792024-08-30T19:46:01.775ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.977465ms iteration = 4 status = {"expiration":"2024-08-30T19:36:01.769780502Z","pruned":[]}
8802024-08-30T19:46:01.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8812024-08-30T19:46:01.776ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8822024-08-30T19:46:01.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8832024-08-30T19:46:01.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
8842024-08-30T19:46:01.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
8852024-08-30T19:46:01.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862024-08-30T19:46:01.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8872024-08-30T19:46:01.779ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.792425ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
8882024-08-30T19:46:01.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
8892024-08-30T19:46:01.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8902024-08-30T19:46:01.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8912024-08-30T19:46:01.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8922024-08-30T19:46:01.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8932024-08-30T19:46:01.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8942024-08-30T19:46:01.785ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
8952024-08-30T19:46:01.785ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
8962024-08-30T19:46:01.785ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.588766ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
8972024-08-30T19:46:01.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8982024-08-30T19:46:01.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.991696ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
8992024-08-30T19:46:01.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9002024-08-30T19:46:01.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9012024-08-30T19:46:01.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9022024-08-30T19:46:01.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9032024-08-30T19:46:01.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9042024-08-30T19:46:01.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9052024-08-30T19:46:01.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9062024-08-30T19:46:01.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9072024-08-30T19:46:01.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9082024-08-30T19:46:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9092024-08-30T19:46:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9102024-08-30T19:46:01.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9112024-08-30T19:46:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9122024-08-30T19:46:01.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9132024-08-30T19:46:01.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9142024-08-30T19:46:01.800ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9152024-08-30T19:46:01.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9162024-08-30T19:46:01.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9172024-08-30T19:46:01.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9182024-08-30T19:46:01.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9192024-08-30T19:46:01.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9202024-08-30T19:46:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9212024-08-30T19:46:01.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9222024-08-30T19:46:01.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9232024-08-30T19:46:01.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9242024-08-30T19:46:01.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9252024-08-30T19:46:01.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9262024-08-30T19:46:01.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9272024-08-30T19:46:01.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9282024-08-30T19:46:01.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9292024-08-30T19:46:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9302024-08-30T19:46:01.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9312024-08-30T19:46:01.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1048, tv_nsec: 120161321 } })
9322024-08-30T19:46:01.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9332024-08-30T19:46:01.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
9342024-08-30T19:46:01.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.311418ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9352024-08-30T19:46:01.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362024-08-30T19:46:01.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9372024-08-30T19:46:01.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9382024-08-30T19:46:01.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
9392024-08-30T19:46:01.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9402024-08-30T19:46:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9412024-08-30T19:46:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9422024-08-30T19:46:01.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9432024-08-30T19:46:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9442024-08-30T19:46:01.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9452024-08-30T19:46:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9462024-08-30T19:46:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
9472024-08-30T19:46:01.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9482024-08-30T19:46:01.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9492024-08-30T19:46:01.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.118512ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
9502024-08-30T19:46:01.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9512024-08-30T19:46:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9522024-08-30T19:46:01.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.00628ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
9532024-08-30T19:46:01.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
9542024-08-30T19:46:01.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.617162ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
9552024-08-30T19:46:01.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9562024-08-30T19:46:01.832ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
9572024-08-30T19:46:01.832ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9582024-08-30T19:46:01.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9592024-08-30T19:46:01.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9602024-08-30T19:46:01.832ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9612024-08-30T19:46:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9622024-08-30T19:46:01.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9632024-08-30T19:46:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9642024-08-30T19:46:01.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
9652024-08-30T19:46:01.836ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9662024-08-30T19:46:01.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
9672024-08-30T19:46:01.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9682024-08-30T19:46:01.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9692024-08-30T19:46:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9702024-08-30T19:46:01.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.095622ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9712024-08-30T19:46:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9722024-08-30T19:46:01.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9732024-08-30T19:46:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9742024-08-30T19:46:01.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9752024-08-30T19:46:01.842ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9762024-08-30T19:46:01.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9772024-08-30T19:46:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9782024-08-30T19:46:01.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9792024-08-30T19:46:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9802024-08-30T19:46:01.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9812024-08-30T19:46:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9822024-08-30T19:46:01.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9832024-08-30T19:46:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9842024-08-30T19:46:01.847ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
9852024-08-30T19:46:01.847ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.9443ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
9862024-08-30T19:46:01.848ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 77.596042ms iteration = 3 status = {"nsuccess":5}
9872024-08-30T19:46:01.849ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
9882024-08-30T19:46:01.849ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
9892024-08-30T19:46:01.849ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
9902024-08-30T19:46:01.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9912024-08-30T19:46:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9922024-08-30T19:46:01.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9932024-08-30T19:46:01.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9942024-08-30T19:46:01.852ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
9952024-08-30T19:46:01.852ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
9962024-08-30T19:46:01.852ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
9972024-08-30T19:46:01.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9982024-08-30T19:46:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9992024-08-30T19:46:01.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10002024-08-30T19:46:01.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10012024-08-30T19:46:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10022024-08-30T19:46:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10032024-08-30T19:46:01.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10042024-08-30T19:46:01.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10052024-08-30T19:46:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10062024-08-30T19:46:01.855ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
10072024-08-30T19:46:01.855ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 0 version = 2
10082024-08-30T19:46:01.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10092024-08-30T19:46:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10102024-08-30T19:46:01.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10112024-08-30T19:46:01.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10122024-08-30T19:46:01.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10132024-08-30T19:46:01.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10142024-08-30T19:46:01.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10152024-08-30T19:46:01.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10162024-08-30T19:46:01.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10172024-08-30T19:46:01.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10182024-08-30T19:46:01.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10192024-08-30T19:46:01.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10202024-08-30T19:46:01.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10212024-08-30T19:46:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10222024-08-30T19:46:01.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10232024-08-30T19:46:01.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10242024-08-30T19:46:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10252024-08-30T19:46:01.876ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
10262024-08-30T19:46:01.876ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10272024-08-30T19:46:01.876ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.293946ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
10282024-08-30T19:46:01.877ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
10292024-08-30T19:46:01.877ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
10302024-08-30T19:46:01.877ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.465536ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
10312024-08-30T19:46:01.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10322024-08-30T19:46:01.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10332024-08-30T19:46:01.930ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
10342024-08-30T19:46:01.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10352024-08-30T19:46:01.932ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10362024-08-30T19:46:01.932ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c54a134-04ba-45ca-98b3-24d0fcf90854", "content-length": "26", "date": "Fri, 30 Aug 2024 19:46:01 GMT"} })
10372024-08-30T19:46:01.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10382024-08-30T19:46:01.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10392024-08-30T19:46:01.938ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.466926ms iteration = 10 status = {"physical_disks_added":0}
10402024-08-30T19:46:01.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10412024-08-30T19:46:01.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10422024-08-30T19:46:02.044ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
10432024-08-30T19:46:02.094ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 324.948592ms iteration = 7 status = {}
10442024-08-30T19:46:02.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10452024-08-30T19:46:02.096ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10462024-08-30T19:46:02.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
10472024-08-30T19:46:02.096ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10482024-08-30T19:46:02.097ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "850b115a-fc85-46e1-a49e-02007789df46", "content-length": "26", "date": "Fri, 30 Aug 2024 19:46:01 GMT"} })
10492024-08-30T19:46:02.097ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10502024-08-30T19:46:02.098ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c1e76f2f-6684-4aad-abaa-46161a0ae7eb", "content-length": "26", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
10512024-08-30T19:46:02.098ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10522024-08-30T19:46:02.101ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10532024-08-30T19:46:02.101ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
10542024-08-30T19:46:02.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
10552024-08-30T19:46:02.147ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10562024-08-30T19:46:02.148ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ef59c290-508c-45bb-b9d1-a0e3e8a48316", "content-length": "372", "date": "Fri, 30 Aug 2024 19:46:01 GMT"} })
10572024-08-30T19:46:02.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10582024-08-30T19:46:02.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10592024-08-30T19:46:02.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10602024-08-30T19:46:02.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10612024-08-30T19:46:02.152ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10622024-08-30T19:46:02.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10632024-08-30T19:46:02.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10642024-08-30T19:46:02.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10652024-08-30T19:46:02.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10662024-08-30T19:46:02.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10672024-08-30T19:46:02.154ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 1 version = 2
10682024-08-30T19:46:02.154ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
10692024-08-30T19:46:02.154ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-30 19:43:18.363870 UTC dns_group = external generation = 2
10702024-08-30T19:46:02.154ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 384.67859ms iteration = 5 status = {"generation":2}
10712024-08-30T19:46:02.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10722024-08-30T19:46:02.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10732024-08-30T19:46:02.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10742024-08-30T19:46:02.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10752024-08-30T19:46:02.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10762024-08-30T19:46:02.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
10772024-08-30T19:46:02.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10782024-08-30T19:46:02.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10792024-08-30T19:46:02.163ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 392.836163ms iteration = 7 status = 0
10802024-08-30T19:46:02.186ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 416.034601ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10812024-08-30T19:46:02.188ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
10822024-08-30T19:46:02.188ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
10832024-08-30T19:46:02.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10842024-08-30T19:46:02.188ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-30T19:42:58.455639Z, time_modified: 2024-08-30T19:42:58.455639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }) }
10852024-08-30T19:46:02.188ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 418.439652ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]}},"default_endpoint":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
10862024-08-30T19:46:02.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10872024-08-30T19:46:02.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10882024-08-30T19:46:02.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10892024-08-30T19:46:02.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10902024-08-30T19:46:02.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10912024-08-30T19:46:02.199ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
10922024-08-30T19:46:02.199ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
10932024-08-30T19:46:02.199ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-30 19:43:16.884603 UTC dns_group = internal generation = 1
10942024-08-30T19:46:02.199ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 429.998385ms iteration = 5 status = {"generation":1}
10952024-08-30T19:46:02.222ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
10962024-08-30T19:46:02.222ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "101cc0cc-fec9-4106-9c0a-57382aca2c47", "date": "Fri, 30 Aug 2024 19:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
10972024-08-30T19:46:02.222ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
10982024-08-30T19:46:02.224ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2a86c96c-b619-46de-8e81-4bd008d0354c", "date": "Fri, 30 Aug 2024 19:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
10992024-08-30T19:46:02.224ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11002024-08-30T19:46:02.225ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11012024-08-30T19:46:02.225ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 455.570185ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11022024-08-30T19:46:02.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11032024-08-30T19:46:02.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11042024-08-30T19:46:02.259ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11052024-08-30T19:46:02.260ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e78051da-6b9c-4440-adaa-87697e81050e", "content-length": "1", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11062024-08-30T19:46:02.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11072024-08-30T19:46:02.262ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11082024-08-30T19:46:02.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11092024-08-30T19:46:02.264ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 495.112518ms iteration = 7 status = null
11102024-08-30T19:46:02.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11112024-08-30T19:46:02.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ffddd455-d1df-45d0-afb2-8dceee1d6dc2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11122024-08-30T19:46:02.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ffddd455-d1df-45d0-afb2-8dceee1d6dc2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11132024-08-30T19:46:02.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ffddd455-d1df-45d0-afb2-8dceee1d6dc2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11142024-08-30T19:46:02.329ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cc28245a-59f8-45e4-a168-eaf3b3d87916", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11152024-08-30T19:46:02.330ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 560.026446ms iteration = 8 status = {}
11162024-08-30T19:46:02.330ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d0f61799-7700-49c6-a44f-1281366bdb05", "content-length": "691", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11172024-08-30T19:46:02.330ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11182024-08-30T19:46:02.330ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11192024-08-30T19:46:02.330ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11202024-08-30T19:46:02.331ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
11212024-08-30T19:46:02.332ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 562.178324ms iteration = 7 status = {}
11222024-08-30T19:46:02.332ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d66f7976-932b-4d4a-94e7-bc5c608a9766", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
11232024-08-30T19:46:02.332ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
11242024-08-30T19:46:02.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "263ddfdb-b867-4d2a-9f87-0c1cc7d9ccbb", "date": "Fri, 30 Aug 2024 19:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
11252024-08-30T19:46:02.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
11262024-08-30T19:46:02.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7dd7982b-89f7-47d8-aeb8-fafe6bb9a044", "date": "Fri, 30 Aug 2024 19:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
11272024-08-30T19:46:02.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
11282024-08-30T19:46:02.337ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
11292024-08-30T19:46:02.337ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 568.170609ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
11302024-08-30T19:46:02.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11312024-08-30T19:46:02.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11322024-08-30T19:46:02.394ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
11332024-08-30T19:46:02.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11342024-08-30T19:46:02.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11352024-08-30T19:46:02.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11362024-08-30T19:46:02.404ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4e681fc-bb4c-4fac-9611-71a629c8d379", "content-length": "121", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11372024-08-30T19:46:02.404ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11382024-08-30T19:46:02.404ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
11392024-08-30T19:46:02.404ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11402024-08-30T19:46:02.404ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11412024-08-30T19:46:02.404ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
11422024-08-30T19:46:02.404ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
11432024-08-30T19:46:02.404ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
11442024-08-30T19:46:02.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11452024-08-30T19:46:02.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11462024-08-30T19:46:02.406ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11472024-08-30T19:46:02.407ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14d73f08-b2c4-43f4-9d27-18a61578b0af", "content-length": "2", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11482024-08-30T19:46:02.407ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11492024-08-30T19:46:02.407ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5bc4bd9e-6222-43db-a2cc-918ee6413ebf", "content-length": "52", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11502024-08-30T19:46:02.407ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
11512024-08-30T19:46:02.407ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11522024-08-30T19:46:02.494ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f7875d0e-5ff6-49e2-97e1-169fd6439b41", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11532024-08-30T19:46:02.494ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
11542024-08-30T19:46:02.494ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11552024-08-30T19:46:02.495ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1b0ba706-8843-449a-810c-e488d4fcfcc0", "content-length": "667", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11562024-08-30T19:46:02.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11572024-08-30T19:46:02.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11582024-08-30T19:46:02.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11592024-08-30T19:46:02.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11602024-08-30T19:46:02.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11612024-08-30T19:46:02.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11622024-08-30T19:46:02.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11632024-08-30T19:46:02.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11642024-08-30T19:46:02.513ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 742.650761ms iteration = 7 status = {}
11652024-08-30T19:46:02.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a347a9b1-af70-4f54-8b7e-38afea9185a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
11662024-08-30T19:46:02.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a347a9b1-af70-4f54-8b7e-38afea9185a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
11672024-08-30T19:46:02.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a347a9b1-af70-4f54-8b7e-38afea9185a1 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
11682024-08-30T19:46:02.761ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:57874
11692024-08-30T19:46:02.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57874 req_id = 6778c4e6-0139-4225-90f9-951876b5f722 roles = RoleSet { roles: {} } uri = /metrics/producers
11702024-08-30T19:46:02.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57874 req_id = 6778c4e6-0139-4225-90f9-951876b5f722 resource = Database result = Ok(()) uri = /metrics/producers
11712024-08-30T19:46:02.796ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
11722024-08-30T19:46:02.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57874 req_id = 6778c4e6-0139-4225-90f9-951876b5f722 roles = RoleSet { roles: {} } uri = /metrics/producers
11732024-08-30T19:46:02.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57874 req_id = 6778c4e6-0139-4225-90f9-951876b5f722 resource = Database result = Ok(()) uri = /metrics/producers
11742024-08-30T19:46:02.825ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
11752024-08-30T19:46:02.825ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "697cba57-4272-4446-8294-9ffaf97ffd06", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11762024-08-30T19:46:02.825ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 215857b3-317f-4a74-b078-672feeaa0d1e
11772024-08-30T19:46:02.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64180 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57874 req_id = 6778c4e6-0139-4225-90f9-951876b5f722 response_code = 201 uri = /metrics/producers
11782024-08-30T19:46:02.932ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:34867
11792024-08-30T19:46:02.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34867 req_id = d7983df7-824e-4150-ba77-4e444c54192e roles = RoleSet { roles: {} } uri = /metrics/producers
11802024-08-30T19:46:02.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34867 req_id = d7983df7-824e-4150-ba77-4e444c54192e resource = Database result = Ok(()) uri = /metrics/producers
11812024-08-30T19:46:02.967ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
11822024-08-30T19:46:02.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34867 req_id = d7983df7-824e-4150-ba77-4e444c54192e roles = RoleSet { roles: {} } uri = /metrics/producers
11832024-08-30T19:46:02.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34867 req_id = d7983df7-824e-4150-ba77-4e444c54192e resource = Database result = Ok(()) uri = /metrics/producers
11842024-08-30T19:46:03.108ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
11852024-08-30T19:46:03.109ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d19f82f1-0168-4724-a5e0-b0c25b88d52c", "date": "Fri, 30 Aug 2024 19:46:02 GMT"} })
11862024-08-30T19:46:03.109ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 289c9d10-fa69-4638-aac7-3cfc6b4e23be
11872024-08-30T19:46:03.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 177453 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34867 req_id = d7983df7-824e-4150-ba77-4e444c54192e response_code = 201 uri = /metrics/producers
11882024-08-30T19:46:03.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b4c7cc16-80e2-44fa-b37d-8bfa4aa63717 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11892024-08-30T19:46:03.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b4c7cc16-80e2-44fa-b37d-8bfa4aa63717 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11902024-08-30T19:46:03.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b4c7cc16-80e2-44fa-b37d-8bfa4aa63717 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11912024-08-30T19:46:04.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = be0264d0-936b-46df-b09b-f248be6e8066 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11922024-08-30T19:46:04.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = be0264d0-936b-46df-b09b-f248be6e8066 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11932024-08-30T19:46:04.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = be0264d0-936b-46df-b09b-f248be6e8066 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11942024-08-30T19:46:05.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 481eef9a-3d98-457c-af02-5cc6f32f8c95 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11952024-08-30T19:46:05.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 481eef9a-3d98-457c-af02-5cc6f32f8c95 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11962024-08-30T19:46:05.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 481eef9a-3d98-457c-af02-5cc6f32f8c95 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11972024-08-30T19:46:06.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d4ea768-97bb-458a-a939-f18cecdb2eb2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11982024-08-30T19:46:06.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d4ea768-97bb-458a-a939-f18cecdb2eb2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
11992024-08-30T19:46:06.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d4ea768-97bb-458a-a939-f18cecdb2eb2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12002024-08-30T19:46:07.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = df5b8488-9f54-4d12-8dec-9d12ec2df337 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12012024-08-30T19:46:07.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = df5b8488-9f54-4d12-8dec-9d12ec2df337 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12022024-08-30T19:46:07.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = df5b8488-9f54-4d12-8dec-9d12ec2df337 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12032024-08-30T19:46:08.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f174b786-1c66-401e-a559-510241ff62bd roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12042024-08-30T19:46:08.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f174b786-1c66-401e-a559-510241ff62bd resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12052024-08-30T19:46:08.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f174b786-1c66-401e-a559-510241ff62bd response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12062024-08-30T19:46:09.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 56044dec-9f6a-4058-9a01-305f4be1c422 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12072024-08-30T19:46:09.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 56044dec-9f6a-4058-9a01-305f4be1c422 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12082024-08-30T19:46:09.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 56044dec-9f6a-4058-9a01-305f4be1c422 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12092024-08-30T19:46:10.065ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1327 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 95dbc7f8-c088-487a-b61f-568bda0e6de0 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
12102024-08-30T19:46:10.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c3e71df-f1b0-496b-bef5-d0aef7b330a2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12112024-08-30T19:46:10.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c3e71df-f1b0-496b-bef5-d0aef7b330a2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12122024-08-30T19:46:10.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c3e71df-f1b0-496b-bef5-d0aef7b330a2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12132024-08-30T19:46:11.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1020bec6-6d2a-4b62-9664-8c73ffc0c13a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12142024-08-30T19:46:11.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1020bec6-6d2a-4b62-9664-8c73ffc0c13a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12152024-08-30T19:46:11.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1020bec6-6d2a-4b62-9664-8c73ffc0c13a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12162024-08-30T19:46:11.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
12172024-08-30T19:46:11.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
12182024-08-30T19:46:11.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12192024-08-30T19:46:11.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12202024-08-30T19:46:11.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12212024-08-30T19:46:11.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12222024-08-30T19:46:11.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12232024-08-30T19:46:11.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12242024-08-30T19:46:11.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12252024-08-30T19:46:11.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.302695ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12262024-08-30T19:46:11.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12272024-08-30T19:46:11.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12282024-08-30T19:46:11.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12292024-08-30T19:46:11.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12302024-08-30T19:46:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12312024-08-30T19:46:11.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12322024-08-30T19:46:11.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
12332024-08-30T19:46:11.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12342024-08-30T19:46:11.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12352024-08-30T19:46:11.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
12362024-08-30T19:46:11.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.174094ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
12372024-08-30T19:46:12.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1deeafd7-bbdc-4d0c-b86b-9c0a15d683de roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12382024-08-30T19:46:12.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1deeafd7-bbdc-4d0c-b86b-9c0a15d683de resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12392024-08-30T19:46:12.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1deeafd7-bbdc-4d0c-b86b-9c0a15d683de response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12402024-08-30T19:46:13.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8c09d534-0e37-45a2-8e0f-8711a2d99b3d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12412024-08-30T19:46:13.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8c09d534-0e37-45a2-8e0f-8711a2d99b3d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12422024-08-30T19:46:13.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8c09d534-0e37-45a2-8e0f-8711a2d99b3d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12432024-08-30T19:46:14.326ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60748
12442024-08-30T19:46:14.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60748 req_id = 46d814ed-bfdd-4c87-84cd-cf477fd84a1c roles = RoleSet { roles: {} } uri = /metrics/producers
12452024-08-30T19:46:14.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60748 req_id = 46d814ed-bfdd-4c87-84cd-cf477fd84a1c resource = Database result = Ok(()) uri = /metrics/producers
12462024-08-30T19:46:14.358ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
12472024-08-30T19:46:14.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60748 req_id = 46d814ed-bfdd-4c87-84cd-cf477fd84a1c roles = RoleSet { roles: {} } uri = /metrics/producers
12482024-08-30T19:46:14.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60748 req_id = 46d814ed-bfdd-4c87-84cd-cf477fd84a1c resource = Database result = Ok(()) uri = /metrics/producers
12492024-08-30T19:46:14.488ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
12502024-08-30T19:46:14.489ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d6a27f8b-72fd-4a57-a7f6-197d1af8b3a2", "date": "Fri, 30 Aug 2024 19:46:14 GMT"} })
12512024-08-30T19:46:14.489ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = e392e9bc-bfce-46aa-93ab-b26313dd4677
12522024-08-30T19:46:14.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 165200 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60748 req_id = 46d814ed-bfdd-4c87-84cd-cf477fd84a1c response_code = 201 uri = /metrics/producers
12532024-08-30T19:46:14.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae281f53-6e9d-4ae5-9da1-1e13c7c9d071 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12542024-08-30T19:46:14.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae281f53-6e9d-4ae5-9da1-1e13c7c9d071 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12552024-08-30T19:46:14.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae281f53-6e9d-4ae5-9da1-1e13c7c9d071 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12562024-08-30T19:46:15.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9f00e9cb-d6c2-494c-be34-3c4cae68cebe roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12572024-08-30T19:46:15.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9f00e9cb-d6c2-494c-be34-3c4cae68cebe resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12582024-08-30T19:46:15.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9f00e9cb-d6c2-494c-be34-3c4cae68cebe response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12592024-08-30T19:46:16.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b7519576-7e89-4c59-af7d-c20d9ca93ec9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12602024-08-30T19:46:16.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b7519576-7e89-4c59-af7d-c20d9ca93ec9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12612024-08-30T19:46:16.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b7519576-7e89-4c59-af7d-c20d9ca93ec9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12622024-08-30T19:46:17.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1222767f-dfa7-4bfe-bf8c-b0f9a259699f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12632024-08-30T19:46:17.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1222767f-dfa7-4bfe-bf8c-b0f9a259699f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12642024-08-30T19:46:17.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1222767f-dfa7-4bfe-bf8c-b0f9a259699f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12652024-08-30T19:46:18.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c734bf67-fb29-4d69-a66f-0c07c340458f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12662024-08-30T19:46:18.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c734bf67-fb29-4d69-a66f-0c07c340458f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12672024-08-30T19:46:18.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c734bf67-fb29-4d69-a66f-0c07c340458f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12682024-08-30T19:46:19.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c1526d6f-0f81-4ffe-85cc-5c19afffd725 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12692024-08-30T19:46:19.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c1526d6f-0f81-4ffe-85cc-5c19afffd725 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12702024-08-30T19:46:19.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c1526d6f-0f81-4ffe-85cc-5c19afffd725 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12712024-08-30T19:46:20.066ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 5cd58b5f-09fc-4f98-8709-37d7f505be9b response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
12722024-08-30T19:46:20.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 86969b62-ad82-408f-93a8-c4c9b1725b11 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12732024-08-30T19:46:20.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 86969b62-ad82-408f-93a8-c4c9b1725b11 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12742024-08-30T19:46:20.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 86969b62-ad82-408f-93a8-c4c9b1725b11 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12752024-08-30T19:46:21.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4281b0f7-72df-439d-bcc5-297ec1ad8199 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12762024-08-30T19:46:21.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4281b0f7-72df-439d-bcc5-297ec1ad8199 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12772024-08-30T19:46:21.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4281b0f7-72df-439d-bcc5-297ec1ad8199 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
12782024-08-30T19:46:21.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
12792024-08-30T19:46:21.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
12802024-08-30T19:46:21.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12812024-08-30T19:46:21.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12822024-08-30T19:46:21.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12832024-08-30T19:46:21.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12842024-08-30T19:46:21.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852024-08-30T19:46:21.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12862024-08-30T19:46:21.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12872024-08-30T19:46:21.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12882024-08-30T19:46:21.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12892024-08-30T19:46:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12902024-08-30T19:46:21.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12912024-08-30T19:46:21.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
12922024-08-30T19:46:21.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12932024-08-30T19:46:21.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12942024-08-30T19:46:21.792ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
12952024-08-30T19:46:21.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.032326ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
12962024-08-30T19:46:21.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12972024-08-30T19:46:21.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12982024-08-30T19:46:21.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.804655ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12992024-08-30T19:46:22.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b5ae742c-7f31-4288-9459-c063cbc4fde8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13002024-08-30T19:46:22.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b5ae742c-7f31-4288-9459-c063cbc4fde8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13012024-08-30T19:46:22.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b5ae742c-7f31-4288-9459-c063cbc4fde8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13022024-08-30T19:46:23.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = adaadd78-6252-44a1-974e-c89062db5198 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13032024-08-30T19:46:23.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = adaadd78-6252-44a1-974e-c89062db5198 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13042024-08-30T19:46:23.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = adaadd78-6252-44a1-974e-c89062db5198 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13052024-08-30T19:46:24.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c13a8298-abc6-4e65-972c-a4fe19e2167c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13062024-08-30T19:46:24.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c13a8298-abc6-4e65-972c-a4fe19e2167c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13072024-08-30T19:46:24.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c13a8298-abc6-4e65-972c-a4fe19e2167c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13082024-08-30T19:46:25.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e2401db-8a8d-4eef-85c4-701652888c99 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13092024-08-30T19:46:25.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e2401db-8a8d-4eef-85c4-701652888c99 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13102024-08-30T19:46:25.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e2401db-8a8d-4eef-85c4-701652888c99 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13112024-08-30T19:46:26.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9ca1dd58-9b15-471e-9364-ac36c80f76e1 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13122024-08-30T19:46:26.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9ca1dd58-9b15-471e-9364-ac36c80f76e1 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13132024-08-30T19:46:26.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9ca1dd58-9b15-471e-9364-ac36c80f76e1 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13142024-08-30T19:46:27.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c63a9cd8-d940-470e-a425-be1463ee709f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13152024-08-30T19:46:27.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c63a9cd8-d940-470e-a425-be1463ee709f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13162024-08-30T19:46:27.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c63a9cd8-d940-470e-a425-be1463ee709f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13172024-08-30T19:46:28.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad98ffb9-3389-4e57-88a3-1d9e6bbfd084 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13182024-08-30T19:46:28.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad98ffb9-3389-4e57-88a3-1d9e6bbfd084 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13192024-08-30T19:46:28.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad98ffb9-3389-4e57-88a3-1d9e6bbfd084 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13202024-08-30T19:46:29.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 74435808-0031-46f7-946f-52066ec9c8b2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13212024-08-30T19:46:29.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 74435808-0031-46f7-946f-52066ec9c8b2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13222024-08-30T19:46:29.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 74435808-0031-46f7-946f-52066ec9c8b2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13232024-08-30T19:46:30.066ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1476 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 3b706b74-0634-45c2-80ee-a7b456f3e7b4 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
13242024-08-30T19:46:30.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9d983db3-2e51-4861-b937-ab66642253b7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13252024-08-30T19:46:30.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9d983db3-2e51-4861-b937-ab66642253b7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13262024-08-30T19:46:30.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9d983db3-2e51-4861-b937-ab66642253b7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
13272024-08-30T19:46:31.770ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
13282024-08-30T19:46:31.770ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
13292024-08-30T19:46:31.770ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13302024-08-30T19:46:31.770ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
13312024-08-30T19:46:31.770ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13322024-08-30T19:46:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13332024-08-30T19:46:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13342024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
13352024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13362024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
13372024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13382024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
13392024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13402024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13412024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
13422024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
13432024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13442024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
13452024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13462024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13472024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
13482024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13492024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
13502024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13512024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
13522024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
13532024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13542024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13552024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
13562024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13572024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
13582024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13592024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
13602024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13612024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
13622024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13632024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13642024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13652024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13662024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13672024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13682024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13692024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13702024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13712024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13722024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13732024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13742024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13752024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13762024-08-30T19:46:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13772024-08-30T19:46:31.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1078, tv_nsec: 79597219 } })
13782024-08-30T19:46:31.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
13792024-08-30T19:46:31.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1078, tv_nsec: 81144536 } })
13802024-08-30T19:46:31.774ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.436258ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13812024-08-30T19:46:31.774ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
13822024-08-30T19:46:31.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13832024-08-30T19:46:31.775ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
13842024-08-30T19:46:31.775ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13852024-08-30T19:46:31.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13862024-08-30T19:46:31.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13872024-08-30T19:46:31.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13882024-08-30T19:46:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13892024-08-30T19:46:31.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13902024-08-30T19:46:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13912024-08-30T19:46:31.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13922024-08-30T19:46:31.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13932024-08-30T19:46:31.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13942024-08-30T19:46:31.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13952024-08-30T19:46:31.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13962024-08-30T19:46:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13972024-08-30T19:46:31.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13982024-08-30T19:46:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13992024-08-30T19:46:31.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14002024-08-30T19:46:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14012024-08-30T19:46:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14022024-08-30T19:46:31.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14032024-08-30T19:46:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14042024-08-30T19:46:31.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14052024-08-30T19:46:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14062024-08-30T19:46:31.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14072024-08-30T19:46:31.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14082024-08-30T19:46:31.791ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1078, tv_nsec: 98650693 } })
14092024-08-30T19:46:31.793ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
14102024-08-30T19:46:31.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112024-08-30T19:46:31.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
14122024-08-30T19:46:31.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14132024-08-30T19:46:31.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14142024-08-30T19:46:31.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152024-08-30T19:46:31.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14162024-08-30T19:46:31.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14172024-08-30T19:46:31.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14182024-08-30T19:46:31.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.546258ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
14192024-08-30T19:46:31.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14202024-08-30T19:46:31.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14212024-08-30T19:46:31.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14222024-08-30T19:46:31.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14232024-08-30T19:46:31.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14242024-08-30T19:46:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14252024-08-30T19:46:31.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.291188ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14262024-08-30T19:46:31.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14272024-08-30T19:46:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14282024-08-30T19:46:31.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
14292024-08-30T19:46:31.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.958842ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
14302024-08-30T19:46:31.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.818232ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
14312024-08-30T19:46:31.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14322024-08-30T19:46:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14332024-08-30T19:46:31.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14342024-08-30T19:46:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14352024-08-30T19:46:31.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362024-08-30T19:46:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14372024-08-30T19:46:31.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14382024-08-30T19:46:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14392024-08-30T19:46:31.839ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
14402024-08-30T19:46:31.839ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14412024-08-30T19:46:31.839ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 68.684835ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
14422024-08-30T19:46:31.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14432024-08-30T19:46:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14442024-08-30T19:46:31.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14452024-08-30T19:46:31.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14462024-08-30T19:46:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14472024-08-30T19:46:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14482024-08-30T19:46:31.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.279976ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
14492024-08-30T19:46:31.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502024-08-30T19:46:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14512024-08-30T19:46:31.846ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14522024-08-30T19:46:31.846ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14532024-08-30T19:46:31.846ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14542024-08-30T19:46:31.846ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14552024-08-30T19:46:31.846ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "55f4bc3e-003e-4730-8bf1-8fb1c784519d", "content-length": "26", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
14562024-08-30T19:46:31.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14572024-08-30T19:46:31.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582024-08-30T19:46:31.846ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "52cf1947-eff2-4172-8ca5-d1dd17fe96d0", "content-length": "26", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
14592024-08-30T19:46:31.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14602024-08-30T19:46:31.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14612024-08-30T19:46:31.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14622024-08-30T19:46:31.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14632024-08-30T19:46:31.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14642024-08-30T19:46:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14652024-08-30T19:46:31.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14662024-08-30T19:46:31.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14672024-08-30T19:46:31.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14682024-08-30T19:46:31.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14692024-08-30T19:46:31.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14702024-08-30T19:46:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14712024-08-30T19:46:31.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.702004ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14722024-08-30T19:46:31.865ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14732024-08-30T19:46:31.865ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.474287ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14742024-08-30T19:46:31.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14752024-08-30T19:46:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14762024-08-30T19:46:31.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14772024-08-30T19:46:31.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14782024-08-30T19:46:31.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14792024-08-30T19:46:31.871ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.015085ms iteration = 11 status = {"physical_disks_added":0}
14802024-08-30T19:46:31.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
14812024-08-30T19:46:31.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14822024-08-30T19:46:31.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14832024-08-30T19:46:31.873ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.763573ms iteration = 8 status = 0
14842024-08-30T19:46:31.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 110.00754ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14852024-08-30T19:46:31.882ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
14862024-08-30T19:46:31.882ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14872024-08-30T19:46:31.883ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78c69582-80af-4f85-b40c-0bb53a64bd2f", "content-length": "26", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
14882024-08-30T19:46:31.883ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14892024-08-30T19:46:31.884ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
14902024-08-30T19:46:31.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 16b40f02-7e2a-4129-95ad-361d2e5684d2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
14912024-08-30T19:46:31.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 16b40f02-7e2a-4129-95ad-361d2e5684d2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
14922024-08-30T19:46:31.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 16b40f02-7e2a-4129-95ad-361d2e5684d2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
14932024-08-30T19:46:31.964ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.225498ms iteration = 8 status = {}
14942024-08-30T19:46:31.965ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14952024-08-30T19:46:31.965ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c51ed83-d1f6-44b1-b151-c87ff39a1fb4", "content-length": "1", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
14962024-08-30T19:46:31.966ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14972024-08-30T19:46:31.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14982024-08-30T19:46:31.994ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14992024-08-30T19:46:31.994ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0849f86a-7ef4-4ee1-83c3-07d01666ca6e", "content-length": "372", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
15002024-08-30T19:46:31.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15012024-08-30T19:46:31.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15022024-08-30T19:46:31.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15032024-08-30T19:46:31.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15042024-08-30T19:46:31.999ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.875533ms iteration = 8 status = null
15052024-08-30T19:46:32.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15062024-08-30T19:46:32.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15072024-08-30T19:46:32.004ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15082024-08-30T19:46:32.004ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c1490272-19ac-4f99-bee5-af44480dbe73", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
15092024-08-30T19:46:32.006ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.36297ms iteration = 9 status = {}
15102024-08-30T19:46:32.010ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15112024-08-30T19:46:32.011ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb038d43-f0d0-43a4-b1e7-c7319fc220b5", "content-length": "691", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
15122024-08-30T19:46:32.011ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15132024-08-30T19:46:32.011ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15142024-08-30T19:46:32.011ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15152024-08-30T19:46:32.013ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 242.101448ms iteration = 8 status = {}
15162024-08-30T19:46:32.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15172024-08-30T19:46:32.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15182024-08-30T19:46:32.069ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
15192024-08-30T19:46:32.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15202024-08-30T19:46:32.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15212024-08-30T19:46:32.078ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15222024-08-30T19:46:32.079ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68dffed4-52bf-4a89-b538-e7110a34827f", "content-length": "121", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
15232024-08-30T19:46:32.079ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
15242024-08-30T19:46:32.079ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
15252024-08-30T19:46:32.079ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15262024-08-30T19:46:32.079ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15272024-08-30T19:46:32.079ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
15282024-08-30T19:46:32.079ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
15292024-08-30T19:46:32.079ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
15302024-08-30T19:46:32.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15312024-08-30T19:46:32.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15322024-08-30T19:46:32.081ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15332024-08-30T19:46:32.082ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91393fe6-1cf7-45f3-b25d-6f13e38f8fda", "content-length": "2", "date": "Fri, 30 Aug 2024 19:46:32 GMT"} })
15342024-08-30T19:46:32.082ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15352024-08-30T19:46:32.082ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6f088c38-69dd-42cd-82b1-f97561a8448b", "content-length": "52", "date": "Fri, 30 Aug 2024 19:46:32 GMT"} })
15362024-08-30T19:46:32.082ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
15372024-08-30T19:46:32.082ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15382024-08-30T19:46:32.178ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ef6d4ad7-582e-486d-b725-0c3f36fd11d1", "date": "Fri, 30 Aug 2024 19:46:31 GMT"} })
15392024-08-30T19:46:32.178ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
15402024-08-30T19:46:32.178ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15412024-08-30T19:46:32.184ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9271384f-8a35-48cb-873a-e32bdc2c56ee", "content-length": "667", "date": "Fri, 30 Aug 2024 19:46:32 GMT"} })
15422024-08-30T19:46:32.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15432024-08-30T19:46:32.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15442024-08-30T19:46:32.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15452024-08-30T19:46:32.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15462024-08-30T19:46:32.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15472024-08-30T19:46:32.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15482024-08-30T19:46:32.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15492024-08-30T19:46:32.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15502024-08-30T19:46:32.199ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 427.921798ms iteration = 8 status = {}
15512024-08-30T19:46:32.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 734b2a8d-5bb6-467b-9bc4-7449b5e52c35 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
15522024-08-30T19:46:32.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 734b2a8d-5bb6-467b-9bc4-7449b5e52c35 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
15532024-08-30T19:46:32.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 734b2a8d-5bb6-467b-9bc4-7449b5e52c35 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
15542024-08-30T19:46:32.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 20a5b909-05e1-4f33-ad83-73ff09c75d5f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15552024-08-30T19:46:32.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 20a5b909-05e1-4f33-ad83-73ff09c75d5f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15562024-08-30T19:46:32.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 20a5b909-05e1-4f33-ad83-73ff09c75d5f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15572024-08-30T19:46:34.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d7ad251-d728-474f-bffe-70ea9a569dcf roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15582024-08-30T19:46:34.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d7ad251-d728-474f-bffe-70ea9a569dcf resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15592024-08-30T19:46:34.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0d7ad251-d728-474f-bffe-70ea9a569dcf response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15602024-08-30T19:46:35.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 88d969e3-5d7a-4645-b138-d8cffd31a63f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15612024-08-30T19:46:35.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 88d969e3-5d7a-4645-b138-d8cffd31a63f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15622024-08-30T19:46:35.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 88d969e3-5d7a-4645-b138-d8cffd31a63f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15632024-08-30T19:46:36.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17829352-3114-450b-8ce8-f1ec561372de roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15642024-08-30T19:46:36.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17829352-3114-450b-8ce8-f1ec561372de resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15652024-08-30T19:46:36.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17829352-3114-450b-8ce8-f1ec561372de response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15662024-08-30T19:46:37.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9eeeb578-eff7-4db9-abe9-de5473385d5b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15672024-08-30T19:46:37.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9eeeb578-eff7-4db9-abe9-de5473385d5b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15682024-08-30T19:46:37.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9eeeb578-eff7-4db9-abe9-de5473385d5b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15692024-08-30T19:46:38.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b3f7a2ff-faaa-47d3-84d4-0fa7de9773c7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15702024-08-30T19:46:38.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b3f7a2ff-faaa-47d3-84d4-0fa7de9773c7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15712024-08-30T19:46:38.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b3f7a2ff-faaa-47d3-84d4-0fa7de9773c7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15722024-08-30T19:46:39.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f439b674-ce62-428d-8c93-e756e255c680 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15732024-08-30T19:46:39.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f439b674-ce62-428d-8c93-e756e255c680 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15742024-08-30T19:46:39.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f439b674-ce62-428d-8c93-e756e255c680 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15752024-08-30T19:46:40.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 58719641-e206-487b-ab3d-808cb314163f response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
15762024-08-30T19:46:40.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41d0f3cd-f2b2-437c-9292-79751fee9bb2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15772024-08-30T19:46:40.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41d0f3cd-f2b2-437c-9292-79751fee9bb2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15782024-08-30T19:46:40.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41d0f3cd-f2b2-437c-9292-79751fee9bb2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15792024-08-30T19:46:41.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5245dc9c-e2d7-4e39-8e62-1c6a7255be5a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15802024-08-30T19:46:41.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5245dc9c-e2d7-4e39-8e62-1c6a7255be5a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15812024-08-30T19:46:41.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5245dc9c-e2d7-4e39-8e62-1c6a7255be5a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
15822024-08-30T19:46:41.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
15832024-08-30T19:46:41.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
15842024-08-30T19:46:41.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15852024-08-30T19:46:41.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15862024-08-30T19:46:41.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15872024-08-30T19:46:41.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15882024-08-30T19:46:41.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892024-08-30T19:46:41.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15902024-08-30T19:46:41.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15912024-08-30T19:46:41.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.640294ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15922024-08-30T19:46:41.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15932024-08-30T19:46:41.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15942024-08-30T19:46:41.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15952024-08-30T19:46:41.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15962024-08-30T19:46:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15972024-08-30T19:46:41.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15982024-08-30T19:46:41.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
15992024-08-30T19:46:41.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16002024-08-30T19:46:41.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16012024-08-30T19:46:41.790ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
16022024-08-30T19:46:41.790ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.992734ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
16032024-08-30T19:46:42.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 323b46d4-7a91-48f9-9d4e-8d50b332e6ba roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16042024-08-30T19:46:42.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 323b46d4-7a91-48f9-9d4e-8d50b332e6ba resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16052024-08-30T19:46:42.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 323b46d4-7a91-48f9-9d4e-8d50b332e6ba response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16062024-08-30T19:46:43.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8eac4c82-d448-4062-980f-bd7f1404c273 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16072024-08-30T19:46:43.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8eac4c82-d448-4062-980f-bd7f1404c273 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16082024-08-30T19:46:43.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8eac4c82-d448-4062-980f-bd7f1404c273 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16092024-08-30T19:46:44.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = deb646cd-52a3-4d58-bfb7-a1569af69783 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16102024-08-30T19:46:44.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = deb646cd-52a3-4d58-bfb7-a1569af69783 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16112024-08-30T19:46:44.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = deb646cd-52a3-4d58-bfb7-a1569af69783 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16122024-08-30T19:46:45.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 258597d2-8ac0-47f9-b18d-60c838b89427 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16132024-08-30T19:46:45.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 258597d2-8ac0-47f9-b18d-60c838b89427 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16142024-08-30T19:46:45.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 258597d2-8ac0-47f9-b18d-60c838b89427 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16152024-08-30T19:46:46.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7e5cb178-d926-47da-94cb-a00fc7599aa8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16162024-08-30T19:46:46.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7e5cb178-d926-47da-94cb-a00fc7599aa8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16172024-08-30T19:46:46.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7e5cb178-d926-47da-94cb-a00fc7599aa8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16182024-08-30T19:46:47.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7b09d054-7f3e-4f32-b57f-cfe4d5012283 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16192024-08-30T19:46:47.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7b09d054-7f3e-4f32-b57f-cfe4d5012283 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16202024-08-30T19:46:47.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7b09d054-7f3e-4f32-b57f-cfe4d5012283 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16212024-08-30T19:46:48.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41b6607c-b715-45b8-84b6-de937e4cd72a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16222024-08-30T19:46:48.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41b6607c-b715-45b8-84b6-de937e4cd72a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16232024-08-30T19:46:48.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 41b6607c-b715-45b8-84b6-de937e4cd72a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16242024-08-30T19:46:49.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fada8ef6-aa33-478f-9059-fd39f0fbf390 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16252024-08-30T19:46:49.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fada8ef6-aa33-478f-9059-fd39f0fbf390 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16262024-08-30T19:46:49.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fada8ef6-aa33-478f-9059-fd39f0fbf390 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16272024-08-30T19:46:50.066ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = a74916a1-a2e1-4d14-a37b-b56a4c033b16 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
16282024-08-30T19:46:50.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e329657-2e1c-49ab-abeb-9c105fc457db roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16292024-08-30T19:46:50.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e329657-2e1c-49ab-abeb-9c105fc457db resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16302024-08-30T19:46:50.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e329657-2e1c-49ab-abeb-9c105fc457db response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16312024-08-30T19:46:51.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b35600e1-479d-4e8a-96ae-14555993281a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16322024-08-30T19:46:51.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b35600e1-479d-4e8a-96ae-14555993281a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16332024-08-30T19:46:51.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b35600e1-479d-4e8a-96ae-14555993281a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16342024-08-30T19:46:51.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
16352024-08-30T19:46:51.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
16362024-08-30T19:46:51.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16372024-08-30T19:46:51.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16382024-08-30T19:46:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16392024-08-30T19:46:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16402024-08-30T19:46:51.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16412024-08-30T19:46:51.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16422024-08-30T19:46:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16432024-08-30T19:46:51.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16442024-08-30T19:46:51.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16452024-08-30T19:46:51.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16462024-08-30T19:46:51.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16472024-08-30T19:46:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16482024-08-30T19:46:51.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-08-30T19:46:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
16502024-08-30T19:46:51.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16512024-08-30T19:46:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16522024-08-30T19:46:51.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
16532024-08-30T19:46:51.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.687093ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
16542024-08-30T19:46:51.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.16619ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16552024-08-30T19:46:52.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fcf64b67-912a-48f9-9faa-59fd012bedb5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16562024-08-30T19:46:52.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fcf64b67-912a-48f9-9faa-59fd012bedb5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16572024-08-30T19:46:52.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fcf64b67-912a-48f9-9faa-59fd012bedb5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16582024-08-30T19:46:53.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2b5542c1-558e-47b2-9209-6d9eeda8878e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16592024-08-30T19:46:53.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2b5542c1-558e-47b2-9209-6d9eeda8878e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16602024-08-30T19:46:53.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2b5542c1-558e-47b2-9209-6d9eeda8878e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16612024-08-30T19:46:54.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 67e28bdb-a8a4-433f-a9cc-4b40b01c6b10 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16622024-08-30T19:46:54.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 67e28bdb-a8a4-433f-a9cc-4b40b01c6b10 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16632024-08-30T19:46:54.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 67e28bdb-a8a4-433f-a9cc-4b40b01c6b10 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16642024-08-30T19:46:55.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 02d62770-a5a1-4a8e-948f-f991bf87ea09 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16652024-08-30T19:46:55.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 02d62770-a5a1-4a8e-948f-f991bf87ea09 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16662024-08-30T19:46:55.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 02d62770-a5a1-4a8e-948f-f991bf87ea09 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16672024-08-30T19:46:56.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 72c6e17c-2081-4630-84bc-ad40225e43a8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16682024-08-30T19:46:56.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 72c6e17c-2081-4630-84bc-ad40225e43a8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16692024-08-30T19:46:56.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 72c6e17c-2081-4630-84bc-ad40225e43a8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16702024-08-30T19:46:57.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = efcb2a73-6e33-49e0-8aea-2ba8e5d44bb0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16712024-08-30T19:46:57.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = efcb2a73-6e33-49e0-8aea-2ba8e5d44bb0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16722024-08-30T19:46:57.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = efcb2a73-6e33-49e0-8aea-2ba8e5d44bb0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16732024-08-30T19:46:58.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2144cba7-4654-4c96-862a-066bb26b2097 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16742024-08-30T19:46:58.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2144cba7-4654-4c96-862a-066bb26b2097 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16752024-08-30T19:46:58.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2144cba7-4654-4c96-862a-066bb26b2097 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16762024-08-30T19:46:59.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7d62c365-7223-4427-a0c0-f3eefefa6d79 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16772024-08-30T19:46:59.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7d62c365-7223-4427-a0c0-f3eefefa6d79 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16782024-08-30T19:46:59.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7d62c365-7223-4427-a0c0-f3eefefa6d79 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16792024-08-30T19:47:00.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1499 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 0ae9f842-f8d8-4104-b957-4aa4051a19d9 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
16802024-08-30T19:47:00.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 38d22a86-1ec8-4f3d-b23b-21c9a1f769bb roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16812024-08-30T19:47:00.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 38d22a86-1ec8-4f3d-b23b-21c9a1f769bb resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16822024-08-30T19:47:00.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 38d22a86-1ec8-4f3d-b23b-21c9a1f769bb response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16832024-08-30T19:47:01.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 60cf8217-8484-4ad6-b2b6-a8302a76af19 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16842024-08-30T19:47:01.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 60cf8217-8484-4ad6-b2b6-a8302a76af19 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16852024-08-30T19:47:01.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 60cf8217-8484-4ad6-b2b6-a8302a76af19 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
16862024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
16872024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
16882024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16892024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
16902024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
16912024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16922024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16932024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
16942024-08-30T19:47:01.769ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-30 19:37:01.769841791 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16952024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
16962024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
16972024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16982024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16992024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
17002024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
17012024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17022024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17032024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
17042024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17052024-08-30T19:47:01.769ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
17062024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17072024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17082024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17092024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17102024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17112024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17122024-08-30T19:47:01.770ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8b642bba-10a6-428b-9af7-48d5f8622e03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5d7b957-0082-4dc3-b742-d6e7150a43c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1108, tv_nsec: 77252798 } })
17132024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
17142024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
17152024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
17162024-08-30T19:47:01.770ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17172024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17182024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17192024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
17202024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17212024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17222024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
17232024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17242024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
17252024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17262024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
17272024-08-30T19:47:01.770ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
17282024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17292024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
17302024-08-30T19:47:01.770ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25
17312024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.1\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25"}
17322024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
17332024-08-30T19:47:01.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17352024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
17362024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
17372024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
17382024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17392024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17402024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17412024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
17422024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17432024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17442024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
17452024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17462024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
17472024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17482024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
17492024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
17502024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17512024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17522024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17532024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
17542024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17552024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17562024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17572024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17582024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17592024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17602024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17612024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17622024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17632024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17642024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17652024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17662024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17672024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17682024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17692024-08-30T19:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17702024-08-30T19:47:01.772ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5636b10-76ec-4aa4-8bd4-1f95780813df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1108, tv_nsec: 79144961 } })
17712024-08-30T19:47:01.773ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.879768ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17722024-08-30T19:47:01.774ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
17732024-08-30T19:47:01.774ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.404838ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
17742024-08-30T19:47:01.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17752024-08-30T19:47:01.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17762024-08-30T19:47:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17772024-08-30T19:47:01.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17782024-08-30T19:47:01.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17792024-08-30T19:47:01.775ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17802024-08-30T19:47:01.775ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.657959ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17812024-08-30T19:47:01.776ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-30 19:37:01.769841791 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17822024-08-30T19:47:01.776ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.573915ms iteration = 5 status = {"expiration":"2024-08-30T19:37:01.769841791Z","pruned":[]}
17832024-08-30T19:47:01.776ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1108, tv_nsec: 83411426 } })
17842024-08-30T19:47:01.776ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1108, tv_nsec: 83474757 } })
17852024-08-30T19:47:01.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17862024-08-30T19:47:01.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17872024-08-30T19:47:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17882024-08-30T19:47:01.778ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
17892024-08-30T19:47:01.778ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
17902024-08-30T19:47:01.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.534267ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
17912024-08-30T19:47:01.781ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.951232ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
17922024-08-30T19:47:01.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17932024-08-30T19:47:01.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17942024-08-30T19:47:01.784ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17952024-08-30T19:47:01.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17962024-08-30T19:47:01.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972024-08-30T19:47:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17982024-08-30T19:47:01.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17992024-08-30T19:47:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18002024-08-30T19:47:01.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18012024-08-30T19:47:01.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18022024-08-30T19:47:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18032024-08-30T19:47:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18042024-08-30T19:47:01.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18052024-08-30T19:47:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18062024-08-30T19:47:01.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18072024-08-30T19:47:01.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18082024-08-30T19:47:01.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18092024-08-30T19:47:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18102024-08-30T19:47:01.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18112024-08-30T19:47:01.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18122024-08-30T19:47:01.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18132024-08-30T19:47:01.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18142024-08-30T19:47:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18152024-08-30T19:47:01.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18162024-08-30T19:47:01.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172024-08-30T19:47:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18182024-08-30T19:47:01.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18192024-08-30T19:47:01.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18202024-08-30T19:47:01.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18212024-08-30T19:47:01.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18222024-08-30T19:47:01.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18232024-08-30T19:47:01.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18242024-08-30T19:47:01.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18252024-08-30T19:47:01.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262024-08-30T19:47:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18272024-08-30T19:47:01.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18282024-08-30T19:47:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
18292024-08-30T19:47:01.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18302024-08-30T19:47:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18312024-08-30T19:47:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18322024-08-30T19:47:01.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18332024-08-30T19:47:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18342024-08-30T19:47:01.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352024-08-30T19:47:01.828ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18362024-08-30T19:47:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18372024-08-30T19:47:01.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18382024-08-30T19:47:01.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18392024-08-30T19:47:01.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18402024-08-30T19:47:01.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.911046ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18412024-08-30T19:47:01.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422024-08-30T19:47:01.833ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
18432024-08-30T19:47:01.833ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
18442024-08-30T19:47:01.833ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.442066ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
18452024-08-30T19:47:01.834ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
18462024-08-30T19:47:01.834ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18472024-08-30T19:47:01.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18482024-08-30T19:47:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18492024-08-30T19:47:01.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18502024-08-30T19:47:01.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18512024-08-30T19:47:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18522024-08-30T19:47:01.836ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18532024-08-30T19:47:01.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
18542024-08-30T19:47:01.837ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
18552024-08-30T19:47:01.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.780982ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
18562024-08-30T19:47:01.837ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18572024-08-30T19:47:01.837ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 66.669759ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
18582024-08-30T19:47:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18592024-08-30T19:47:01.837ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18602024-08-30T19:47:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18612024-08-30T19:47:01.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18622024-08-30T19:47:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18632024-08-30T19:47:01.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.08827ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
18642024-08-30T19:47:01.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18652024-08-30T19:47:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18662024-08-30T19:47:01.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18672024-08-30T19:47:01.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18682024-08-30T19:47:01.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18692024-08-30T19:47:01.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18702024-08-30T19:47:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18712024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18722024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18732024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
18742024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18752024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18762024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18772024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18782024-08-30T19:47:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18792024-08-30T19:47:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18802024-08-30T19:47:01.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18812024-08-30T19:47:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18822024-08-30T19:47:01.851ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18832024-08-30T19:47:01.851ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18842024-08-30T19:47:01.851ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18852024-08-30T19:47:01.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18862024-08-30T19:47:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18872024-08-30T19:47:01.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.132193ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
18882024-08-30T19:47:01.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.575134ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18892024-08-30T19:47:01.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18902024-08-30T19:47:01.859ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18912024-08-30T19:47:01.859ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18922024-08-30T19:47:01.859ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18932024-08-30T19:47:01.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18942024-08-30T19:47:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18952024-08-30T19:47:01.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18962024-08-30T19:47:01.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18972024-08-30T19:47:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18982024-08-30T19:47:01.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18992024-08-30T19:47:01.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19002024-08-30T19:47:01.886ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19012024-08-30T19:47:01.886ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19022024-08-30T19:47:01.887ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.24177ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19032024-08-30T19:47:01.890ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19042024-08-30T19:47:01.890ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.016279ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19052024-08-30T19:47:01.898ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19062024-08-30T19:47:01.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19072024-08-30T19:47:02.037ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19082024-08-30T19:47:02.038ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ba2072a5-7a49-4f2a-a987-693b8e746fa7", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19092024-08-30T19:47:02.038ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19102024-08-30T19:47:02.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5381304c-0a08-4e2c-bf3e-185c8e3b6657", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19112024-08-30T19:47:02.040ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19122024-08-30T19:47:02.042ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19132024-08-30T19:47:02.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 272.216066ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
19142024-08-30T19:47:02.053ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19152024-08-30T19:47:02.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19162024-08-30T19:47:02.109ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19172024-08-30T19:47:02.109ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "033c03e2-938a-4352-b982-1edc7ed4ee67", "content-length": "26", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} })
19182024-08-30T19:47:02.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19192024-08-30T19:47:02.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19202024-08-30T19:47:02.135ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19212024-08-30T19:47:02.135ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19222024-08-30T19:47:02.136ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9f83f9d-b388-4c39-943a-32824861ffd9", "content-length": "26", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} })
19232024-08-30T19:47:02.136ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19242024-08-30T19:47:02.139ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19252024-08-30T19:47:02.158ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19262024-08-30T19:47:02.158ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6b6be0b-a4b8-4b19-8d4b-203d6d65a923", "content-length": "691", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
19272024-08-30T19:47:02.158ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
19282024-08-30T19:47:02.158ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
19292024-08-30T19:47:02.158ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
19302024-08-30T19:47:02.159ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 388.896915ms iteration = 9 status = 0
19312024-08-30T19:47:02.160ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.481284ms iteration = 9 status = {}
19322024-08-30T19:47:02.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1108, tv_nsec: 467614538 } })
19332024-08-30T19:47:02.161ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19342024-08-30T19:47:02.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19352024-08-30T19:47:02.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362024-08-30T19:47:02.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 390.869579ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19372024-08-30T19:47:02.162ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
19382024-08-30T19:47:02.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19392024-08-30T19:47:02.162ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19402024-08-30T19:47:02.163ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19412024-08-30T19:47:02.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19422024-08-30T19:47:02.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19432024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19442024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19452024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19462024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19472024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19482024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19492024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19502024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19512024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19522024-08-30T19:47:02.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19532024-08-30T19:47:02.174ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
19542024-08-30T19:47:02.174ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "583124a3-31b3-4312-9b99-cda2fbb259f0", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
19552024-08-30T19:47:02.174ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
19562024-08-30T19:47:02.176ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aefc8ebd-6230-42f6-9a9b-e5e65e0a8154", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
19572024-08-30T19:47:02.176ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
19582024-08-30T19:47:02.179ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "384b5f89-1ede-4dbd-91c0-8b86824993e5", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
19592024-08-30T19:47:02.179ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
19602024-08-30T19:47:02.181ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
19612024-08-30T19:47:02.181ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 411.672934ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
19622024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19632024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 0 version = 2
19642024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19652024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19662024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19672024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19682024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19692024-08-30T19:47:02.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19702024-08-30T19:47:02.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19712024-08-30T19:47:02.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19722024-08-30T19:47:02.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19732024-08-30T19:47:02.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19742024-08-30T19:47:02.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19752024-08-30T19:47:02.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19762024-08-30T19:47:02.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19772024-08-30T19:47:02.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19782024-08-30T19:47:02.209ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 1 version = 2
19792024-08-30T19:47:02.209ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19802024-08-30T19:47:02.209ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-30 19:43:18.363870 UTC dns_group = external generation = 2
19812024-08-30T19:47:02.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 440.027392ms iteration = 6 status = {"generation":2}
19822024-08-30T19:47:02.210ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
19832024-08-30T19:47:02.210ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19842024-08-30T19:47:02.210ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-30 19:43:16.884603 UTC dns_group = internal generation = 1
19852024-08-30T19:47:02.210ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 441.10547ms iteration = 6 status = {"generation":1}
19862024-08-30T19:47:02.213ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-30T19:42:58.455639Z, time_modified: 2024-08-30T19:42:58.455639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }) }
19872024-08-30T19:47:02.213ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 443.866249ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]}},"default_endpoint":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19882024-08-30T19:47:02.234ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 464.723674ms iteration = 9 status = {}
19892024-08-30T19:47:02.245ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19902024-08-30T19:47:02.246ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "702f9506-f824-46d9-9a03-5707fc7da0f5", "content-length": "1", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
19912024-08-30T19:47:02.248ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19922024-08-30T19:47:02.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19932024-08-30T19:47:02.257ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 486.505927ms iteration = 12 status = {"physical_disks_added":0}
19942024-08-30T19:47:02.285ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
19952024-08-30T19:47:02.285ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19962024-08-30T19:47:02.286ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eb89c39d-8899-4281-8a48-000b13c95bf0", "content-length": "26", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} })
19972024-08-30T19:47:02.286ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19982024-08-30T19:47:02.287ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
19992024-08-30T19:47:02.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20002024-08-30T19:47:02.323ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 553.797407ms iteration = 9 status = null
20012024-08-30T19:47:02.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4d7129b8-6438-4037-a856-dd007f20c3b2", "content-length": "372", "date": "Fri, 30 Aug 2024 19:47:01 GMT"} })
20022024-08-30T19:47:02.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20032024-08-30T19:47:02.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20042024-08-30T19:47:02.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20052024-08-30T19:47:02.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20062024-08-30T19:47:02.343ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20072024-08-30T19:47:02.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20082024-08-30T19:47:02.346ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20092024-08-30T19:47:02.347ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5d82f27e-443f-4add-aff0-3852f8675271", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
20102024-08-30T19:47:02.348ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 577.32745ms iteration = 10 status = {}
20112024-08-30T19:47:02.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20122024-08-30T19:47:02.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20132024-08-30T19:47:02.398ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
20142024-08-30T19:47:02.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20152024-08-30T19:47:02.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20162024-08-30T19:47:02.407ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20172024-08-30T19:47:02.407ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "028c59be-1ea5-48f2-9f67-7a7c43ff3112", "content-length": "121", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
20182024-08-30T19:47:02.407ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
20192024-08-30T19:47:02.408ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
20202024-08-30T19:47:02.408ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20212024-08-30T19:47:02.408ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20222024-08-30T19:47:02.408ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
20232024-08-30T19:47:02.408ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
20242024-08-30T19:47:02.408ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
20252024-08-30T19:47:02.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20262024-08-30T19:47:02.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20272024-08-30T19:47:02.410ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20282024-08-30T19:47:02.410ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c993e223-8228-4d6c-9a9c-b23bc1b73193", "content-length": "2", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
20292024-08-30T19:47:02.410ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20302024-08-30T19:47:02.410ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d47c9793-8649-4f76-82ae-435a523a17f8", "content-length": "52", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
20312024-08-30T19:47:02.410ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
20322024-08-30T19:47:02.410ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20332024-08-30T19:47:02.509ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9d6c4b48-0e4e-46cc-84a2-dd367d9d5718", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
20342024-08-30T19:47:02.509ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
20352024-08-30T19:47:02.509ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20362024-08-30T19:47:02.509ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "53b34dca-a709-4668-9e1a-bab73278c6ce", "content-length": "667", "date": "Fri, 30 Aug 2024 19:47:02 GMT"} })
20372024-08-30T19:47:02.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20382024-08-30T19:47:02.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20392024-08-30T19:47:02.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20402024-08-30T19:47:02.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20412024-08-30T19:47:02.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20422024-08-30T19:47:02.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20432024-08-30T19:47:02.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20442024-08-30T19:47:02.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20452024-08-30T19:47:02.527ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 756.117388ms iteration = 9 status = {}
20462024-08-30T19:47:02.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cf76cd5c-b68c-4a84-8cee-346619bdd3bf roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20472024-08-30T19:47:02.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cf76cd5c-b68c-4a84-8cee-346619bdd3bf resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20482024-08-30T19:47:02.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cf76cd5c-b68c-4a84-8cee-346619bdd3bf response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20492024-08-30T19:47:02.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 36bb8c76-b101-4f1b-98eb-5e722c277d6d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
20502024-08-30T19:47:02.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 36bb8c76-b101-4f1b-98eb-5e722c277d6d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
20512024-08-30T19:47:02.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 36bb8c76-b101-4f1b-98eb-5e722c277d6d response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
20522024-08-30T19:47:03.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52f6bd0e-0e6b-48e1-989a-ebc2d28c2ead roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20532024-08-30T19:47:03.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52f6bd0e-0e6b-48e1-989a-ebc2d28c2ead resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20542024-08-30T19:47:03.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52f6bd0e-0e6b-48e1-989a-ebc2d28c2ead response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20552024-08-30T19:47:04.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 05121b01-68b4-4df4-b94a-b58e67fa456b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20562024-08-30T19:47:04.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 05121b01-68b4-4df4-b94a-b58e67fa456b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20572024-08-30T19:47:04.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 05121b01-68b4-4df4-b94a-b58e67fa456b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20582024-08-30T19:47:05.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 986b1f0b-0fbc-4a09-9c4a-6dfd27aeda8b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20592024-08-30T19:47:05.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 986b1f0b-0fbc-4a09-9c4a-6dfd27aeda8b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20602024-08-30T19:47:05.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 986b1f0b-0fbc-4a09-9c4a-6dfd27aeda8b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20612024-08-30T19:47:06.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39116821-4c1d-4459-a992-fbd0c1b4939d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20622024-08-30T19:47:06.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39116821-4c1d-4459-a992-fbd0c1b4939d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20632024-08-30T19:47:06.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39116821-4c1d-4459-a992-fbd0c1b4939d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20642024-08-30T19:47:07.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = afc1318c-e24e-4dbe-898b-09c3cf184b10 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20652024-08-30T19:47:07.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = afc1318c-e24e-4dbe-898b-09c3cf184b10 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20662024-08-30T19:47:07.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = afc1318c-e24e-4dbe-898b-09c3cf184b10 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20672024-08-30T19:47:08.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e15b09ab-a4dc-40cd-9a3e-44f0be5b1c2a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20682024-08-30T19:47:08.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e15b09ab-a4dc-40cd-9a3e-44f0be5b1c2a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20692024-08-30T19:47:08.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e15b09ab-a4dc-40cd-9a3e-44f0be5b1c2a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20702024-08-30T19:47:09.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd90d67c-3e5b-4787-9702-96ac76b8bb7b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20712024-08-30T19:47:09.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd90d67c-3e5b-4787-9702-96ac76b8bb7b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20722024-08-30T19:47:09.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fd90d67c-3e5b-4787-9702-96ac76b8bb7b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20732024-08-30T19:47:10.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1340 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 2cd62ee1-b752-427a-96e5-ef84d837d2b6 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
20742024-08-30T19:47:10.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 385c468c-6c50-43f2-bf9f-9e397e56c469 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20752024-08-30T19:47:10.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 385c468c-6c50-43f2-bf9f-9e397e56c469 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20762024-08-30T19:47:10.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 385c468c-6c50-43f2-bf9f-9e397e56c469 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20772024-08-30T19:47:11.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
20782024-08-30T19:47:11.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
20792024-08-30T19:47:11.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20802024-08-30T19:47:11.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20812024-08-30T19:47:11.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20822024-08-30T19:47:11.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20832024-08-30T19:47:11.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20842024-08-30T19:47:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20852024-08-30T19:47:11.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20862024-08-30T19:47:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20872024-08-30T19:47:11.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20882024-08-30T19:47:11.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20892024-08-30T19:47:11.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20902024-08-30T19:47:11.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
20912024-08-30T19:47:11.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20922024-08-30T19:47:11.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20932024-08-30T19:47:11.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
20942024-08-30T19:47:11.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.285061ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
20952024-08-30T19:47:11.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20962024-08-30T19:47:11.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20972024-08-30T19:47:11.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f4164ea6-4343-492d-b040-62f9a57ec1c4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20982024-08-30T19:47:11.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f4164ea6-4343-492d-b040-62f9a57ec1c4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
20992024-08-30T19:47:11.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f4164ea6-4343-492d-b040-62f9a57ec1c4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21002024-08-30T19:47:11.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.807694ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21012024-08-30T19:47:12.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d232bd64-f15d-4776-a948-15985e987689 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21022024-08-30T19:47:12.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d232bd64-f15d-4776-a948-15985e987689 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21032024-08-30T19:47:12.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d232bd64-f15d-4776-a948-15985e987689 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21042024-08-30T19:47:13.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3131223a-05fb-4ff9-9fb0-4bb58d68b019 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21052024-08-30T19:47:13.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3131223a-05fb-4ff9-9fb0-4bb58d68b019 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21062024-08-30T19:47:13.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3131223a-05fb-4ff9-9fb0-4bb58d68b019 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21072024-08-30T19:47:14.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c12c45f8-1ee7-4ceb-b85e-15be5bcd3854 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21082024-08-30T19:47:14.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c12c45f8-1ee7-4ceb-b85e-15be5bcd3854 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21092024-08-30T19:47:14.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c12c45f8-1ee7-4ceb-b85e-15be5bcd3854 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21102024-08-30T19:47:15.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e3a7364-6107-4fa6-8c72-65feb644fb20 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21112024-08-30T19:47:15.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e3a7364-6107-4fa6-8c72-65feb644fb20 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21122024-08-30T19:47:15.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e3a7364-6107-4fa6-8c72-65feb644fb20 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21132024-08-30T19:47:16.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2d4b1c07-c4a0-4b5e-be63-5faa5143181f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21142024-08-30T19:47:16.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2d4b1c07-c4a0-4b5e-be63-5faa5143181f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21152024-08-30T19:47:16.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2d4b1c07-c4a0-4b5e-be63-5faa5143181f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21162024-08-30T19:47:17.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1e3fc8fa-a366-4960-b5f9-37c85534c4ef roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21172024-08-30T19:47:17.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1e3fc8fa-a366-4960-b5f9-37c85534c4ef resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21182024-08-30T19:47:17.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1e3fc8fa-a366-4960-b5f9-37c85534c4ef response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21192024-08-30T19:47:18.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 68a6de39-fdb4-4c85-8a4d-00a711042c40 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21202024-08-30T19:47:18.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 68a6de39-fdb4-4c85-8a4d-00a711042c40 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21212024-08-30T19:47:18.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 68a6de39-fdb4-4c85-8a4d-00a711042c40 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21222024-08-30T19:47:19.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0e7b99af-d383-4689-82ac-e4bc4e8f5857 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21232024-08-30T19:47:19.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0e7b99af-d383-4689-82ac-e4bc4e8f5857 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21242024-08-30T19:47:19.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0e7b99af-d383-4689-82ac-e4bc4e8f5857 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21252024-08-30T19:47:20.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1864 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 24c2abb0-df92-4bf3-8fec-57436f43a9aa response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
21262024-08-30T19:47:21.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fc2608ec-a1d3-44d2-9ef3-3785bef257ca roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21272024-08-30T19:47:21.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fc2608ec-a1d3-44d2-9ef3-3785bef257ca resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21282024-08-30T19:47:21.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fc2608ec-a1d3-44d2-9ef3-3785bef257ca response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21292024-08-30T19:47:21.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
21302024-08-30T19:47:21.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
21312024-08-30T19:47:21.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21322024-08-30T19:47:21.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21332024-08-30T19:47:21.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21342024-08-30T19:47:21.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21352024-08-30T19:47:21.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21362024-08-30T19:47:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21372024-08-30T19:47:21.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21382024-08-30T19:47:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21392024-08-30T19:47:21.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21402024-08-30T19:47:21.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21412024-08-30T19:47:21.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21422024-08-30T19:47:21.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21432024-08-30T19:47:21.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.64004ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21442024-08-30T19:47:21.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452024-08-30T19:47:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
21462024-08-30T19:47:21.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21472024-08-30T19:47:21.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21482024-08-30T19:47:21.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
21492024-08-30T19:47:21.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.904828ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
21502024-08-30T19:47:22.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 588c804b-9e00-4e90-9e92-96a5449fcd55 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21512024-08-30T19:47:22.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 588c804b-9e00-4e90-9e92-96a5449fcd55 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21522024-08-30T19:47:22.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 588c804b-9e00-4e90-9e92-96a5449fcd55 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21532024-08-30T19:47:23.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d1cdbaf9-024c-4372-93a4-b16635af2b50 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21542024-08-30T19:47:23.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d1cdbaf9-024c-4372-93a4-b16635af2b50 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21552024-08-30T19:47:23.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d1cdbaf9-024c-4372-93a4-b16635af2b50 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21562024-08-30T19:47:24.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dc3cb478-4525-4b66-9d59-de4bae270faf roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21572024-08-30T19:47:24.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dc3cb478-4525-4b66-9d59-de4bae270faf resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21582024-08-30T19:47:24.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dc3cb478-4525-4b66-9d59-de4bae270faf response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21592024-08-30T19:47:25.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d15f388d-6213-4be8-8ceb-5a21f8cdd6f8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21602024-08-30T19:47:25.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d15f388d-6213-4be8-8ceb-5a21f8cdd6f8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21612024-08-30T19:47:25.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d15f388d-6213-4be8-8ceb-5a21f8cdd6f8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21622024-08-30T19:47:26.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 99eb6873-f270-4549-bd1f-94d994c9ad2a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21632024-08-30T19:47:26.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 99eb6873-f270-4549-bd1f-94d994c9ad2a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21642024-08-30T19:47:26.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 99eb6873-f270-4549-bd1f-94d994c9ad2a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21652024-08-30T19:47:27.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 04deb4f6-5476-4ffe-81fc-ff697a38e41b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21662024-08-30T19:47:27.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 04deb4f6-5476-4ffe-81fc-ff697a38e41b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21672024-08-30T19:47:27.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 04deb4f6-5476-4ffe-81fc-ff697a38e41b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21682024-08-30T19:47:28.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c7f784cc-9cc2-467b-b6ab-0614e984cb4c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21692024-08-30T19:47:28.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c7f784cc-9cc2-467b-b6ab-0614e984cb4c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21702024-08-30T19:47:28.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c7f784cc-9cc2-467b-b6ab-0614e984cb4c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21712024-08-30T19:47:29.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3202e225-c83d-433c-8e5f-e61cc8215d9a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21722024-08-30T19:47:29.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3202e225-c83d-433c-8e5f-e61cc8215d9a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21732024-08-30T19:47:29.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3202e225-c83d-433c-8e5f-e61cc8215d9a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21742024-08-30T19:47:30.066ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1317 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = f8733db3-9bdd-449e-bbd4-ddb2d5566984 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
21752024-08-30T19:47:30.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 765c726a-3677-48ff-98e5-becdb6ea1d06 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21762024-08-30T19:47:30.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 765c726a-3677-48ff-98e5-becdb6ea1d06 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21772024-08-30T19:47:30.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 765c726a-3677-48ff-98e5-becdb6ea1d06 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21782024-08-30T19:47:31.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 36e02196-9969-4ff4-8b25-0e292a998914 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21792024-08-30T19:47:31.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 36e02196-9969-4ff4-8b25-0e292a998914 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21802024-08-30T19:47:31.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 36e02196-9969-4ff4-8b25-0e292a998914 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
21812024-08-30T19:47:31.770ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
21822024-08-30T19:47:31.770ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
21832024-08-30T19:47:31.770ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21842024-08-30T19:47:31.770ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
21852024-08-30T19:47:31.770ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21862024-08-30T19:47:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21872024-08-30T19:47:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21882024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
21892024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
21902024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21912024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
21922024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21932024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21942024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
21952024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21962024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
21972024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21982024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
21992024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22002024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22012024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
22022024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
22032024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22042024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22052024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
22062024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22072024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
22082024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
22092024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22102024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22112024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
22122024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
22132024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22142024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22152024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
22162024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22172024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22182024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22192024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22202024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22212024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22222024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22232024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22242024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22252024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22262024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22272024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22282024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22292024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22302024-08-30T19:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22312024-08-30T19:47:31.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1138, tv_nsec: 79571978 } })
22322024-08-30T19:47:31.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22332024-08-30T19:47:31.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1138, tv_nsec: 79683950 } })
22342024-08-30T19:47:31.773ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.546482ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22352024-08-30T19:47:31.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
22362024-08-30T19:47:31.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
22372024-08-30T19:47:31.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22382024-08-30T19:47:31.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22392024-08-30T19:47:31.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22402024-08-30T19:47:31.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22412024-08-30T19:47:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22422024-08-30T19:47:31.784ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22432024-08-30T19:47:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22442024-08-30T19:47:31.784ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1138, tv_nsec: 90563191 } })
22452024-08-30T19:47:31.785ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
22462024-08-30T19:47:31.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22472024-08-30T19:47:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22482024-08-30T19:47:31.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22492024-08-30T19:47:31.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22502024-08-30T19:47:31.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22512024-08-30T19:47:31.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22522024-08-30T19:47:31.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.953824ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
22532024-08-30T19:47:31.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22542024-08-30T19:47:31.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22552024-08-30T19:47:31.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22562024-08-30T19:47:31.816ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
22572024-08-30T19:47:31.816ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22582024-08-30T19:47:31.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22592024-08-30T19:47:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22602024-08-30T19:47:31.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22612024-08-30T19:47:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22622024-08-30T19:47:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22632024-08-30T19:47:31.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22642024-08-30T19:47:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22652024-08-30T19:47:31.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22662024-08-30T19:47:31.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.835839ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
22672024-08-30T19:47:31.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22682024-08-30T19:47:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22692024-08-30T19:47:31.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22702024-08-30T19:47:31.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22712024-08-30T19:47:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22722024-08-30T19:47:31.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22732024-08-30T19:47:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22742024-08-30T19:47:31.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22752024-08-30T19:47:31.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22762024-08-30T19:47:31.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22772024-08-30T19:47:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22782024-08-30T19:47:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22792024-08-30T19:47:31.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22802024-08-30T19:47:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22812024-08-30T19:47:31.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22822024-08-30T19:47:31.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22832024-08-30T19:47:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22842024-08-30T19:47:31.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22852024-08-30T19:47:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22862024-08-30T19:47:31.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22872024-08-30T19:47:31.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22882024-08-30T19:47:31.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22892024-08-30T19:47:31.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22902024-08-30T19:47:31.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22912024-08-30T19:47:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22922024-08-30T19:47:31.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22932024-08-30T19:47:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22942024-08-30T19:47:31.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22952024-08-30T19:47:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22962024-08-30T19:47:31.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22972024-08-30T19:47:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
22982024-08-30T19:47:31.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22992024-08-30T19:47:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23002024-08-30T19:47:31.850ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.820641ms iteration = 10 status = 0
23012024-08-30T19:47:31.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
23022024-08-30T19:47:31.851ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23032024-08-30T19:47:31.852ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "051d048a-c6b5-48ce-abb3-6b80b861041b", "content-length": "26", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23042024-08-30T19:47:31.852ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23052024-08-30T19:47:31.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23062024-08-30T19:47:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23072024-08-30T19:47:31.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23082024-08-30T19:47:31.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23092024-08-30T19:47:31.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.59866ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
23102024-08-30T19:47:31.866ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
23112024-08-30T19:47:31.866ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23122024-08-30T19:47:31.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.886745ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
23132024-08-30T19:47:31.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.506606ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23142024-08-30T19:47:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
23152024-08-30T19:47:31.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23162024-08-30T19:47:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23172024-08-30T19:47:31.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.788419ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23182024-08-30T19:47:31.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
23192024-08-30T19:47:31.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23202024-08-30T19:47:31.880ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ca9cb30-91cc-4ea0-99c2-b2a2ddcbb8de", "content-length": "26", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23212024-08-30T19:47:31.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23222024-08-30T19:47:31.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23232024-08-30T19:47:31.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
23242024-08-30T19:47:31.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.414373ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
23252024-08-30T19:47:31.887ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
23262024-08-30T19:47:31.887ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23272024-08-30T19:47:31.887ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "030552d9-04d8-4ac8-bc52-1b568ec20580", "content-length": "26", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23282024-08-30T19:47:31.887ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23292024-08-30T19:47:31.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
23302024-08-30T19:47:31.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.893236ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23312024-08-30T19:47:31.914ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23322024-08-30T19:47:31.914ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 143.117621ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23332024-08-30T19:47:31.926ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 155.923516ms iteration = 10 status = {}
23342024-08-30T19:47:31.927ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.400114ms iteration = 13 status = {"physical_disks_added":0}
23352024-08-30T19:47:31.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23362024-08-30T19:47:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23372024-08-30T19:47:31.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23382024-08-30T19:47:31.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23392024-08-30T19:47:31.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23402024-08-30T19:47:31.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23412024-08-30T19:47:31.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23422024-08-30T19:47:31.952ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23432024-08-30T19:47:31.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23442024-08-30T19:47:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23452024-08-30T19:47:31.959ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23462024-08-30T19:47:31.959ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0a44d4fa-70ab-4ffa-a345-ec6234cc588d", "content-length": "1", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23472024-08-30T19:47:31.962ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23482024-08-30T19:47:31.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23492024-08-30T19:47:31.980ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23502024-08-30T19:47:31.982ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 212.53105ms iteration = 10 status = null
23512024-08-30T19:47:32.004ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23522024-08-30T19:47:32.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "399c657e-d80f-4815-be3f-a0b08afcf4cb", "content-length": "691", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23532024-08-30T19:47:32.007ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
23542024-08-30T19:47:32.007ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
23552024-08-30T19:47:32.007ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
23562024-08-30T19:47:32.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d22b60ed-b001-42ee-a960-ad4be3212fd8", "content-length": "372", "date": "Fri, 30 Aug 2024 19:47:32 GMT"} })
23572024-08-30T19:47:32.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23582024-08-30T19:47:32.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23592024-08-30T19:47:32.009ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 237.785663ms iteration = 10 status = {}
23602024-08-30T19:47:32.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23612024-08-30T19:47:32.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23622024-08-30T19:47:32.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23632024-08-30T19:47:32.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23642024-08-30T19:47:32.019ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23652024-08-30T19:47:32.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9c0af170-da23-4da1-9d96-707581945e25", "date": "Fri, 30 Aug 2024 19:47:32 GMT"} })
23662024-08-30T19:47:32.020ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.686571ms iteration = 11 status = {}
23672024-08-30T19:47:32.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23682024-08-30T19:47:32.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23692024-08-30T19:47:32.045ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
23702024-08-30T19:47:32.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23712024-08-30T19:47:32.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23722024-08-30T19:47:32.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23732024-08-30T19:47:32.052ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3a6765-65a2-4a8c-ad98-ff0ce49fcd70", "content-length": "121", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23742024-08-30T19:47:32.052ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
23752024-08-30T19:47:32.052ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
23762024-08-30T19:47:32.053ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23772024-08-30T19:47:32.053ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23782024-08-30T19:47:32.053ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
23792024-08-30T19:47:32.053ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
23802024-08-30T19:47:32.053ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
23812024-08-30T19:47:32.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23822024-08-30T19:47:32.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23832024-08-30T19:47:32.055ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23842024-08-30T19:47:32.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f85a687-90b6-415d-a1ff-9a91054f35d7", "content-length": "2", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23852024-08-30T19:47:32.055ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23862024-08-30T19:47:32.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa30abd7-c037-4d72-9ae1-881998e3da93", "content-length": "52", "date": "Fri, 30 Aug 2024 19:47:31 GMT"} })
23872024-08-30T19:47:32.055ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
23882024-08-30T19:47:32.055ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23892024-08-30T19:47:32.153ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1da2d695-a512-45f3-9d25-6986745fc020", "date": "Fri, 30 Aug 2024 19:47:32 GMT"} })
23902024-08-30T19:47:32.153ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
23912024-08-30T19:47:32.153ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23922024-08-30T19:47:32.157ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f5f09bb-92f5-4a30-b85c-8d9b61f46f67", "content-length": "667", "date": "Fri, 30 Aug 2024 19:47:32 GMT"} })
23932024-08-30T19:47:32.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23942024-08-30T19:47:32.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23952024-08-30T19:47:32.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23962024-08-30T19:47:32.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23972024-08-30T19:47:32.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23982024-08-30T19:47:32.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23992024-08-30T19:47:32.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24002024-08-30T19:47:32.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24012024-08-30T19:47:32.173ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 401.900692ms iteration = 10 status = {}
24022024-08-30T19:47:32.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec639ab5-2434-43be-8d01-ab9e23c57fc6 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24032024-08-30T19:47:32.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec639ab5-2434-43be-8d01-ab9e23c57fc6 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24042024-08-30T19:47:32.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec639ab5-2434-43be-8d01-ab9e23c57fc6 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24052024-08-30T19:47:32.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 88e2560a-165a-4d5f-a7be-b2ccaafc459b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
24062024-08-30T19:47:32.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 88e2560a-165a-4d5f-a7be-b2ccaafc459b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
24072024-08-30T19:47:32.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 88e2560a-165a-4d5f-a7be-b2ccaafc459b response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
24082024-08-30T19:47:33.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8d98e377-1899-4478-858d-d02b0cb90c46 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24092024-08-30T19:47:33.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8d98e377-1899-4478-858d-d02b0cb90c46 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24102024-08-30T19:47:33.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8d98e377-1899-4478-858d-d02b0cb90c46 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24112024-08-30T19:47:34.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a55171c3-ca36-4966-92f0-dd96a1e6d2e5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24122024-08-30T19:47:34.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a55171c3-ca36-4966-92f0-dd96a1e6d2e5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24132024-08-30T19:47:34.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a55171c3-ca36-4966-92f0-dd96a1e6d2e5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24142024-08-30T19:47:35.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1dc97543-e6c7-4f6a-a52b-09cc05aa8a6d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24152024-08-30T19:47:35.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1dc97543-e6c7-4f6a-a52b-09cc05aa8a6d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24162024-08-30T19:47:35.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1dc97543-e6c7-4f6a-a52b-09cc05aa8a6d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24172024-08-30T19:47:36.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 70b66b27-5602-4696-bb2f-1f475994109e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24182024-08-30T19:47:36.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 70b66b27-5602-4696-bb2f-1f475994109e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24192024-08-30T19:47:36.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 70b66b27-5602-4696-bb2f-1f475994109e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24202024-08-30T19:47:37.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d8aa5c8f-d270-406f-9145-9f5aec347d48 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24212024-08-30T19:47:37.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d8aa5c8f-d270-406f-9145-9f5aec347d48 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24222024-08-30T19:47:37.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d8aa5c8f-d270-406f-9145-9f5aec347d48 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24232024-08-30T19:47:38.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3b5d576d-0d21-4874-9446-1cc2dae7bc69 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24242024-08-30T19:47:38.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3b5d576d-0d21-4874-9446-1cc2dae7bc69 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24252024-08-30T19:47:38.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3b5d576d-0d21-4874-9446-1cc2dae7bc69 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24262024-08-30T19:47:39.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3de5b37e-3ff8-4bf6-b359-e8e45e041971 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24272024-08-30T19:47:39.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3de5b37e-3ff8-4bf6-b359-e8e45e041971 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24282024-08-30T19:47:39.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3de5b37e-3ff8-4bf6-b359-e8e45e041971 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24292024-08-30T19:47:40.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1497 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = fcfef935-23d9-4fd4-948b-5f3f7fcaed6a response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
24302024-08-30T19:47:40.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 22abb2a3-301a-4177-b3e9-ac8f6f1ceef3 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24312024-08-30T19:47:40.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 22abb2a3-301a-4177-b3e9-ac8f6f1ceef3 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24322024-08-30T19:47:40.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 22abb2a3-301a-4177-b3e9-ac8f6f1ceef3 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24332024-08-30T19:47:41.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39fb5b15-0460-4ce6-afbc-fae9de4c2a4d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24342024-08-30T19:47:41.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39fb5b15-0460-4ce6-afbc-fae9de4c2a4d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24352024-08-30T19:47:41.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39fb5b15-0460-4ce6-afbc-fae9de4c2a4d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24362024-08-30T19:47:41.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
24372024-08-30T19:47:41.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
24382024-08-30T19:47:41.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24392024-08-30T19:47:41.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24402024-08-30T19:47:41.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24412024-08-30T19:47:41.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24422024-08-30T19:47:41.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24432024-08-30T19:47:41.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24442024-08-30T19:47:41.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24452024-08-30T19:47:41.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24462024-08-30T19:47:41.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24472024-08-30T19:47:41.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24482024-08-30T19:47:41.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24492024-08-30T19:47:41.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24502024-08-30T19:47:41.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24512024-08-30T19:47:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
24522024-08-30T19:47:41.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24532024-08-30T19:47:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24542024-08-30T19:47:41.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
24552024-08-30T19:47:41.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.102115ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
24562024-08-30T19:47:41.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.794567ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24572024-08-30T19:47:42.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c1e0137a-79c4-4b4f-b435-36a5f0b25ece roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24582024-08-30T19:47:42.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c1e0137a-79c4-4b4f-b435-36a5f0b25ece resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24592024-08-30T19:47:42.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c1e0137a-79c4-4b4f-b435-36a5f0b25ece response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24602024-08-30T19:47:43.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f7ec89c8-8f36-481f-828b-d0b2ce9b99ea roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24612024-08-30T19:47:43.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f7ec89c8-8f36-481f-828b-d0b2ce9b99ea resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24622024-08-30T19:47:43.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f7ec89c8-8f36-481f-828b-d0b2ce9b99ea response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24632024-08-30T19:47:44.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c1c9133-cddc-468d-8771-0c24052aaad8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24642024-08-30T19:47:44.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c1c9133-cddc-468d-8771-0c24052aaad8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24652024-08-30T19:47:44.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c1c9133-cddc-468d-8771-0c24052aaad8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24662024-08-30T19:47:45.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 94e8f73e-e38d-4aa9-b284-db4f1286b463 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24672024-08-30T19:47:45.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 94e8f73e-e38d-4aa9-b284-db4f1286b463 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24682024-08-30T19:47:45.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 94e8f73e-e38d-4aa9-b284-db4f1286b463 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24692024-08-30T19:47:46.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a7e32d50-cb31-4331-bc57-c2124c0332fb roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24702024-08-30T19:47:46.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a7e32d50-cb31-4331-bc57-c2124c0332fb resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24712024-08-30T19:47:46.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a7e32d50-cb31-4331-bc57-c2124c0332fb response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24722024-08-30T19:47:47.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e3423b0-e85f-400c-bfad-128b36c7d2a4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24732024-08-30T19:47:47.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e3423b0-e85f-400c-bfad-128b36c7d2a4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24742024-08-30T19:47:47.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e3423b0-e85f-400c-bfad-128b36c7d2a4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24752024-08-30T19:47:48.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7bb99f81-a427-4e29-865d-bcce20e73e72 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24762024-08-30T19:47:48.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7bb99f81-a427-4e29-865d-bcce20e73e72 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24772024-08-30T19:47:48.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7bb99f81-a427-4e29-865d-bcce20e73e72 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24782024-08-30T19:47:49.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 07c8f3b7-d5be-46f6-ba84-72d10ab462c7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24792024-08-30T19:47:49.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 07c8f3b7-d5be-46f6-ba84-72d10ab462c7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24802024-08-30T19:47:49.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 07c8f3b7-d5be-46f6-ba84-72d10ab462c7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24812024-08-30T19:47:50.066ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1353 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 150c1404-3107-4d60-80fd-8b7afcb50d91 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
24822024-08-30T19:47:50.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ce3cac32-7b53-4c2b-9a69-af0f1202bdb2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24832024-08-30T19:47:50.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ce3cac32-7b53-4c2b-9a69-af0f1202bdb2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24842024-08-30T19:47:50.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ce3cac32-7b53-4c2b-9a69-af0f1202bdb2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24852024-08-30T19:47:51.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 77dae076-833a-4ca5-845e-50fa7eb7f513 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24862024-08-30T19:47:51.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 77dae076-833a-4ca5-845e-50fa7eb7f513 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24872024-08-30T19:47:51.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 77dae076-833a-4ca5-845e-50fa7eb7f513 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
24882024-08-30T19:47:51.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
24892024-08-30T19:47:51.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
24902024-08-30T19:47:51.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24912024-08-30T19:47:51.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24922024-08-30T19:47:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24932024-08-30T19:47:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24942024-08-30T19:47:51.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-08-30T19:47:51.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24962024-08-30T19:47:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24972024-08-30T19:47:51.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.239775ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24982024-08-30T19:47:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24992024-08-30T19:47:51.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25002024-08-30T19:47:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25012024-08-30T19:47:51.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25022024-08-30T19:47:51.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25032024-08-30T19:47:51.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25042024-08-30T19:47:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
25052024-08-30T19:47:51.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25062024-08-30T19:47:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25072024-08-30T19:47:51.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
25082024-08-30T19:47:51.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.096735ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
25092024-08-30T19:47:52.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6b5b5d4a-7b8c-4d13-ab39-776936835fed roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25102024-08-30T19:47:52.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6b5b5d4a-7b8c-4d13-ab39-776936835fed resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25112024-08-30T19:47:52.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6b5b5d4a-7b8c-4d13-ab39-776936835fed response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25122024-08-30T19:47:53.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = df3388df-efb4-41c0-8e5c-a26c4a61d2b8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25132024-08-30T19:47:53.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = df3388df-efb4-41c0-8e5c-a26c4a61d2b8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25142024-08-30T19:47:53.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = df3388df-efb4-41c0-8e5c-a26c4a61d2b8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25152024-08-30T19:47:54.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9632b656-162b-4904-9c20-592bf38b184b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25162024-08-30T19:47:54.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9632b656-162b-4904-9c20-592bf38b184b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25172024-08-30T19:47:54.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9632b656-162b-4904-9c20-592bf38b184b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25182024-08-30T19:47:55.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ca04e2ae-5d8c-4ff8-9510-38b01f2bc2e7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25192024-08-30T19:47:55.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ca04e2ae-5d8c-4ff8-9510-38b01f2bc2e7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25202024-08-30T19:47:55.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ca04e2ae-5d8c-4ff8-9510-38b01f2bc2e7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25212024-08-30T19:47:56.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = da49080b-7903-4d7a-a0db-dfcee2b38e7a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25222024-08-30T19:47:56.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = da49080b-7903-4d7a-a0db-dfcee2b38e7a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25232024-08-30T19:47:56.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = da49080b-7903-4d7a-a0db-dfcee2b38e7a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25242024-08-30T19:47:57.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23cfcfc9-05da-4d5d-a844-04bfd4f5ea1d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25252024-08-30T19:47:57.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23cfcfc9-05da-4d5d-a844-04bfd4f5ea1d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25262024-08-30T19:47:57.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23cfcfc9-05da-4d5d-a844-04bfd4f5ea1d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25272024-08-30T19:47:58.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4d80fd8b-dcf8-4221-a6e4-3022761451a7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25282024-08-30T19:47:58.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4d80fd8b-dcf8-4221-a6e4-3022761451a7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25292024-08-30T19:47:58.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4d80fd8b-dcf8-4221-a6e4-3022761451a7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25302024-08-30T19:47:59.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0ec5327e-b9e0-4fae-a7c5-129f20fbac1c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25312024-08-30T19:47:59.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0ec5327e-b9e0-4fae-a7c5-129f20fbac1c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25322024-08-30T19:47:59.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0ec5327e-b9e0-4fae-a7c5-129f20fbac1c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25332024-08-30T19:48:00.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1353 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = caa93a62-9588-451e-b999-ce49fd2ad759 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
25342024-08-30T19:48:00.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3eef8911-6c3e-46b0-b4e3-15d36c50fae8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25352024-08-30T19:48:00.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3eef8911-6c3e-46b0-b4e3-15d36c50fae8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25362024-08-30T19:48:00.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3eef8911-6c3e-46b0-b4e3-15d36c50fae8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
25372024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
25382024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
25392024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
25402024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25412024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
25422024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
25432024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
25442024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25452024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
25462024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25472024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
25482024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
25492024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25502024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
25512024-08-30T19:48:01.771ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-30 19:38:01.771295596 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
25522024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
25532024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
25542024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
25552024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25562024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
25572024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
25582024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25592024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
25602024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25612024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
25622024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
25632024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25642024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25652024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
25662024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25672024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
25682024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25692024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25702024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
25712024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
25722024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25732024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25742024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
25752024-08-30T19:48:01.771ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
25762024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25772024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
25782024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
25792024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
25802024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25812024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
25822024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25832024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
25842024-08-30T19:48:01.771ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25
25852024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.67\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25"}
25862024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
25872024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
25882024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25892024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25902024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
25912024-08-30T19:48:01.771ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
25922024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25932024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
25942024-08-30T19:48:01.771ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
25952024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
25962024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
25972024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25982024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
25992024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26002024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26012024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26022024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26032024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26042024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26052024-08-30T19:48:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26062024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26072024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26082024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26092024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26102024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26112024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26122024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26132024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26142024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
26152024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26162024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26172024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26182024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26192024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26202024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26212024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26222024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26232024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26242024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26252024-08-30T19:48:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26262024-08-30T19:48:01.773ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5636b10-76ec-4aa4-8bd4-1f95780813df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1168, tv_nsec: 79576418 } })
26272024-08-30T19:48:01.773ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8b642bba-10a6-428b-9af7-48d5f8622e03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5d7b957-0082-4dc3-b742-d6e7150a43c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1168, tv_nsec: 79788802 } })
26282024-08-30T19:48:01.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26292024-08-30T19:48:01.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26302024-08-30T19:48:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26312024-08-30T19:48:01.775ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
26322024-08-30T19:48:01.775ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.633062ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
26332024-08-30T19:48:01.775ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.55857ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26342024-08-30T19:48:01.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26352024-08-30T19:48:01.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26362024-08-30T19:48:01.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26372024-08-30T19:48:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26382024-08-30T19:48:01.778ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
26392024-08-30T19:48:01.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.174906ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
26402024-08-30T19:48:01.778ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1168, tv_nsec: 84632017 } })
26412024-08-30T19:48:01.778ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1168, tv_nsec: 84633827 } })
26422024-08-30T19:48:01.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26432024-08-30T19:48:01.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26442024-08-30T19:48:01.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26452024-08-30T19:48:01.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
26462024-08-30T19:48:01.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
26472024-08-30T19:48:01.780ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-30 19:38:01.771295596 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
26482024-08-30T19:48:01.780ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.525317ms iteration = 6 status = {"expiration":"2024-08-30T19:38:01.771295596Z","pruned":[]}
26492024-08-30T19:48:01.783ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26502024-08-30T19:48:01.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26512024-08-30T19:48:01.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26522024-08-30T19:48:01.784ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.626752ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
26532024-08-30T19:48:01.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26542024-08-30T19:48:01.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26552024-08-30T19:48:01.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26562024-08-30T19:48:01.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26572024-08-30T19:48:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26582024-08-30T19:48:01.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26592024-08-30T19:48:01.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26602024-08-30T19:48:01.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26612024-08-30T19:48:01.798ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26622024-08-30T19:48:01.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 27.225868ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
26632024-08-30T19:48:01.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26642024-08-30T19:48:01.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26652024-08-30T19:48:01.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26662024-08-30T19:48:01.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26672024-08-30T19:48:01.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
26682024-08-30T19:48:01.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26692024-08-30T19:48:01.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1168, tv_nsec: 107965557 } })
26702024-08-30T19:48:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26712024-08-30T19:48:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26722024-08-30T19:48:01.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26732024-08-30T19:48:01.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26742024-08-30T19:48:01.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26752024-08-30T19:48:01.804ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
26762024-08-30T19:48:01.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26772024-08-30T19:48:01.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26782024-08-30T19:48:01.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26792024-08-30T19:48:01.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26802024-08-30T19:48:01.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26812024-08-30T19:48:01.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26822024-08-30T19:48:01.810ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26832024-08-30T19:48:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26842024-08-30T19:48:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
26852024-08-30T19:48:01.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26862024-08-30T19:48:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26872024-08-30T19:48:01.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26882024-08-30T19:48:01.815ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26892024-08-30T19:48:01.815ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26902024-08-30T19:48:01.815ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.814349ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26912024-08-30T19:48:01.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26922024-08-30T19:48:01.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
26932024-08-30T19:48:01.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26942024-08-30T19:48:01.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26952024-08-30T19:48:01.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26962024-08-30T19:48:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26972024-08-30T19:48:01.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26982024-08-30T19:48:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
26992024-08-30T19:48:01.825ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27002024-08-30T19:48:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27012024-08-30T19:48:01.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.578633ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
27022024-08-30T19:48:01.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27032024-08-30T19:48:01.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27042024-08-30T19:48:01.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27052024-08-30T19:48:01.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27062024-08-30T19:48:01.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27072024-08-30T19:48:01.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27082024-08-30T19:48:01.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092024-08-30T19:48:01.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27102024-08-30T19:48:01.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27112024-08-30T19:48:01.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27122024-08-30T19:48:01.835ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
27132024-08-30T19:48:01.835ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27142024-08-30T19:48:01.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27152024-08-30T19:48:01.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 64.500192ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27162024-08-30T19:48:01.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27172024-08-30T19:48:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
27182024-08-30T19:48:01.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27192024-08-30T19:48:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27202024-08-30T19:48:01.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27212024-08-30T19:48:01.837ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
27222024-08-30T19:48:01.837ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
27232024-08-30T19:48:01.837ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.304873ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
27242024-08-30T19:48:01.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27252024-08-30T19:48:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27262024-08-30T19:48:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27272024-08-30T19:48:01.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27282024-08-30T19:48:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27292024-08-30T19:48:01.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27302024-08-30T19:48:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27312024-08-30T19:48:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27322024-08-30T19:48:01.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27332024-08-30T19:48:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27342024-08-30T19:48:01.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
27352024-08-30T19:48:01.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.631982ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
27362024-08-30T19:48:01.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27372024-08-30T19:48:01.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27382024-08-30T19:48:01.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27392024-08-30T19:48:01.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27402024-08-30T19:48:01.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27412024-08-30T19:48:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27422024-08-30T19:48:01.844ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
27432024-08-30T19:48:01.844ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
27442024-08-30T19:48:01.844ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.97334ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
27452024-08-30T19:48:01.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27462024-08-30T19:48:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27472024-08-30T19:48:01.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.359972ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27482024-08-30T19:48:01.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27492024-08-30T19:48:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27502024-08-30T19:48:01.848ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27512024-08-30T19:48:01.848ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27522024-08-30T19:48:01.848ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27532024-08-30T19:48:01.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27542024-08-30T19:48:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27552024-08-30T19:48:01.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27562024-08-30T19:48:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27572024-08-30T19:48:01.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27582024-08-30T19:48:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27592024-08-30T19:48:01.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27602024-08-30T19:48:01.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27612024-08-30T19:48:01.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27622024-08-30T19:48:01.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27632024-08-30T19:48:01.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27642024-08-30T19:48:01.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27652024-08-30T19:48:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27662024-08-30T19:48:01.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27672024-08-30T19:48:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27682024-08-30T19:48:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27692024-08-30T19:48:01.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27702024-08-30T19:48:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27712024-08-30T19:48:01.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27722024-08-30T19:48:01.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27732024-08-30T19:48:01.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27742024-08-30T19:48:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27752024-08-30T19:48:01.863ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
27762024-08-30T19:48:01.863ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
27772024-08-30T19:48:01.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27782024-08-30T19:48:01.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27792024-08-30T19:48:01.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27802024-08-30T19:48:01.866ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 94.788543ms iteration = 14 status = {"physical_disks_added":0}
27812024-08-30T19:48:01.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27822024-08-30T19:48:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27832024-08-30T19:48:01.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27842024-08-30T19:48:01.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27852024-08-30T19:48:01.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27862024-08-30T19:48:01.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27872024-08-30T19:48:01.872ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
27882024-08-30T19:48:01.872ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
27892024-08-30T19:48:01.872ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-30 19:43:16.884603 UTC dns_group = internal generation = 1
27902024-08-30T19:48:01.872ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 101.551881ms iteration = 7 status = {"generation":1}
27912024-08-30T19:48:01.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27922024-08-30T19:48:01.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27932024-08-30T19:48:01.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27942024-08-30T19:48:01.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27952024-08-30T19:48:01.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27962024-08-30T19:48:01.885ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
27972024-08-30T19:48:01.885ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27982024-08-30T19:48:01.885ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.849048ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
27992024-08-30T19:48:01.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 426732e0-99e0-4ef0-ad86-fad841870a79 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
28002024-08-30T19:48:01.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 426732e0-99e0-4ef0-ad86-fad841870a79 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
28012024-08-30T19:48:01.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.799107ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
28022024-08-30T19:48:01.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 426732e0-99e0-4ef0-ad86-fad841870a79 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
28032024-08-30T19:48:01.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28042024-08-30T19:48:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28052024-08-30T19:48:01.890ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
28062024-08-30T19:48:01.890ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
28072024-08-30T19:48:01.890ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
28082024-08-30T19:48:01.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28092024-08-30T19:48:01.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28102024-08-30T19:48:01.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28112024-08-30T19:48:01.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122024-08-30T19:48:01.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
28132024-08-30T19:48:01.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28142024-08-30T19:48:01.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28152024-08-30T19:48:01.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.77815ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
28162024-08-30T19:48:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28172024-08-30T19:48:01.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28182024-08-30T19:48:01.897ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.691485ms iteration = 11 status = 0
28192024-08-30T19:48:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28202024-08-30T19:48:01.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28212024-08-30T19:48:01.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28222024-08-30T19:48:01.909ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-30T19:42:58.455639Z, time_modified: 2024-08-30T19:42:58.455639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }) }
28232024-08-30T19:48:01.909ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 138.063133ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]}},"default_endpoint":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28242024-08-30T19:48:01.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
28252024-08-30T19:48:01.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28262024-08-30T19:48:01.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28272024-08-30T19:48:01.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28282024-08-30T19:48:01.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28292024-08-30T19:48:01.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28302024-08-30T19:48:01.927ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
28312024-08-30T19:48:01.927ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 0 version = 2
28322024-08-30T19:48:01.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28332024-08-30T19:48:01.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28342024-08-30T19:48:01.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
28352024-08-30T19:48:01.984ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28362024-08-30T19:48:01.984ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b50e9ba1-8648-4ecb-b5f0-14a29091ae82", "content-length": "26", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} })
28372024-08-30T19:48:01.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28382024-08-30T19:48:01.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28392024-08-30T19:48:02.043ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
28402024-08-30T19:48:02.043ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28412024-08-30T19:48:02.043ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3073d75f-4df2-4c8e-98c4-73deedd7f0dd", "content-length": "26", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} })
28422024-08-30T19:48:02.043ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28432024-08-30T19:48:02.045ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28442024-08-30T19:48:02.084ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28452024-08-30T19:48:02.086ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
28462024-08-30T19:48:02.086ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28472024-08-30T19:48:02.087ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd4c6b83-9368-4a60-9173-211af52f2fc2", "content-length": "26", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} })
28482024-08-30T19:48:02.087ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28492024-08-30T19:48:02.089ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
28502024-08-30T19:48:02.102ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28512024-08-30T19:48:02.102ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a54f5125-ab19-40a5-a915-a524276b66ef", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28522024-08-30T19:48:02.102ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28532024-08-30T19:48:02.104ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ffacc0c2-ab15-4d02-a383-ff383e3d1e96", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28542024-08-30T19:48:02.104ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28552024-08-30T19:48:02.105ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28562024-08-30T19:48:02.105ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.310667ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28572024-08-30T19:48:02.181ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 409.914543ms iteration = 11 status = {}
28582024-08-30T19:48:02.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28592024-08-30T19:48:02.198ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c36068dd-1461-4669-b333-9c778033c369", "content-length": "372", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
28602024-08-30T19:48:02.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28612024-08-30T19:48:02.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28622024-08-30T19:48:02.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28632024-08-30T19:48:02.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28642024-08-30T19:48:02.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28652024-08-30T19:48:02.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28662024-08-30T19:48:02.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28672024-08-30T19:48:02.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28682024-08-30T19:48:02.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28692024-08-30T19:48:02.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28702024-08-30T19:48:02.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28712024-08-30T19:48:02.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28722024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28732024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
28742024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28752024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28762024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 1 version = 2
28772024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28782024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-30 19:43:18.363870 UTC dns_group = external generation = 2
28792024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 435.485561ms iteration = 7 status = {"generation":2}
28802024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28812024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "62e96a7c-680c-447f-8074-1a86236daca8", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28822024-08-30T19:48:02.206ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28832024-08-30T19:48:02.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28842024-08-30T19:48:02.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28852024-08-30T19:48:02.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a26abdcc-53fb-4356-99c4-3c102997068c", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28862024-08-30T19:48:02.208ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28872024-08-30T19:48:02.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28882024-08-30T19:48:02.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28892024-08-30T19:48:02.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28902024-08-30T19:48:02.209ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28912024-08-30T19:48:02.209ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7c2c9c5e-aad1-45d2-89a0-23de44c64f1c", "content-length": "1", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
28922024-08-30T19:48:02.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28932024-08-30T19:48:02.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28942024-08-30T19:48:02.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "393fa439-63c3-4f94-94db-a7da97afbc98", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28952024-08-30T19:48:02.209ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28962024-08-30T19:48:02.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28972024-08-30T19:48:02.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "48563b7d-cf13-48b6-9bb9-3f89283da62e", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
28982024-08-30T19:48:02.210ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28992024-08-30T19:48:02.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29002024-08-30T19:48:02.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29012024-08-30T19:48:02.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29022024-08-30T19:48:02.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29032024-08-30T19:48:02.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29042024-08-30T19:48:02.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29052024-08-30T19:48:02.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062024-08-30T19:48:02.212ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29072024-08-30T19:48:02.212ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 441.194532ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
29082024-08-30T19:48:02.212ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 440.999919ms iteration = 12 status = {}
29092024-08-30T19:48:02.212ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 441.572339ms iteration = 11 status = null
29102024-08-30T19:48:02.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112024-08-30T19:48:02.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29122024-08-30T19:48:02.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29132024-08-30T19:48:02.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29142024-08-30T19:48:02.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
29152024-08-30T19:48:02.216ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29162024-08-30T19:48:02.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29172024-08-30T19:48:02.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29182024-08-30T19:48:02.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29192024-08-30T19:48:02.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29202024-08-30T19:48:02.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29212024-08-30T19:48:02.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29222024-08-30T19:48:02.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
29232024-08-30T19:48:02.224ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29242024-08-30T19:48:02.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29252024-08-30T19:48:02.228ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29262024-08-30T19:48:02.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29272024-08-30T19:48:02.230ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29282024-08-30T19:48:02.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29292024-08-30T19:48:02.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29302024-08-30T19:48:02.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29312024-08-30T19:48:02.233ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29322024-08-30T19:48:02.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29332024-08-30T19:48:02.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29342024-08-30T19:48:02.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29352024-08-30T19:48:02.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29362024-08-30T19:48:02.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29372024-08-30T19:48:02.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29382024-08-30T19:48:02.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29392024-08-30T19:48:02.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-08-30T19:48:02.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
29412024-08-30T19:48:02.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29422024-08-30T19:48:02.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29432024-08-30T19:48:02.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29442024-08-30T19:48:02.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29452024-08-30T19:48:02.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29462024-08-30T19:48:02.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29472024-08-30T19:48:02.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29482024-08-30T19:48:02.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29492024-08-30T19:48:02.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-08-30T19:48:02.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
29512024-08-30T19:48:02.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29522024-08-30T19:48:02.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29532024-08-30T19:48:02.305ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29542024-08-30T19:48:02.306ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "285866dc-17cb-426c-a8b6-89a24bc8a28a", "content-length": "691", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} })
29552024-08-30T19:48:02.306ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29562024-08-30T19:48:02.306ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29572024-08-30T19:48:02.306ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29582024-08-30T19:48:02.307ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
29592024-08-30T19:48:02.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29602024-08-30T19:48:02.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29612024-08-30T19:48:02.309ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.488772ms iteration = 11 status = {}
29622024-08-30T19:48:02.311ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 148fa4d0-99ac-4f4c-b957-d26cc8730745, kind: Service { id: b5636b10-76ec-4aa4-8bd4-1f95780813df }, name: Name("external-dns-b5636b10-76ec-4aa4-8bd4-1f95780813df"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 107])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ac84e1-d9f1-4c03-8dd9-78d5c3b887de, kind: Service { id: ff52340f-525a-4b88-bfc8-1cb0fe9ceba7 }, name: Name("external-dns-ff52340f-525a-4b88-bfc8-1cb0fe9ceba7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 2495ea70-4560-412b-9ebd-45a2bc27810a, kind: Service { id: d2343105-862a-478c-b746-fd8bb78f9a96 }, name: Name("nexus-d2343105-862a-478c-b746-fd8bb78f9a96"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3e58b382-51e7-46a7-8c87-6ca3a6547a20, kind: Service { id: 1d96d476-acdb-4c44-a486-29569b3bf41e }, name: Name("nexus-1d96d476-acdb-4c44-a486-29569b3bf41e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 82aefc08-c1a4-48ce-8225-d8f4409ab816, kind: Service { id: ba4aef74-7b33-4ded-a46a-dc2534b0db9d }, name: Name("nexus-ba4aef74-7b33-4ded-a46a-dc2534b0db9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
29632024-08-30T19:48:02.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29642024-08-30T19:48:02.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29652024-08-30T19:48:02.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29662024-08-30T19:48:02.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
29672024-08-30T19:48:02.315ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29682024-08-30T19:48:02.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29692024-08-30T19:48:02.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29702024-08-30T19:48:02.316ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
29712024-08-30T19:48:02.316ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 148fa4d0-99ac-4f4c-b957-d26cc8730745, kind: Service { id: b5636b10-76ec-4aa4-8bd4-1f95780813df }, name: Name("external-dns-b5636b10-76ec-4aa4-8bd4-1f95780813df"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 107])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ac84e1-d9f1-4c03-8dd9-78d5c3b887de, kind: Service { id: ff52340f-525a-4b88-bfc8-1cb0fe9ceba7 }, name: Name("external-dns-ff52340f-525a-4b88-bfc8-1cb0fe9ceba7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2495ea70-4560-412b-9ebd-45a2bc27810a, kind: Service { id: d2343105-862a-478c-b746-fd8bb78f9a96 }, name: Name("nexus-d2343105-862a-478c-b746-fd8bb78f9a96"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3e58b382-51e7-46a7-8c87-6ca3a6547a20, kind: Service { id: 1d96d476-acdb-4c44-a486-29569b3bf41e }, name: Name("nexus-1d96d476-acdb-4c44-a486-29569b3bf41e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 82aefc08-c1a4-48ce-8225-d8f4409ab816, kind: Service { id: ba4aef74-7b33-4ded-a46a-dc2534b0db9d }, name: Name("nexus-ba4aef74-7b33-4ded-a46a-dc2534b0db9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
29722024-08-30T19:48:02.316ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
29732024-08-30T19:48:02.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87d76b29-8622-4c0b-8cc2-ac313702ff4e", "content-length": "121", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
29742024-08-30T19:48:02.316ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
29752024-08-30T19:48:02.316ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
29762024-08-30T19:48:02.317ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29772024-08-30T19:48:02.317ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29782024-08-30T19:48:02.317ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
29792024-08-30T19:48:02.317ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
29802024-08-30T19:48:02.317ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
29812024-08-30T19:48:02.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29822024-08-30T19:48:02.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29832024-08-30T19:48:02.318ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29842024-08-30T19:48:02.319ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4fe9e123-5f46-46ae-93f0-edac059aaa28", "content-length": "2", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
29852024-08-30T19:48:02.319ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29862024-08-30T19:48:02.319ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ce3ee847-d061-458f-b0d0-78a7b7c10f65", "content-length": "52", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
29872024-08-30T19:48:02.319ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
29882024-08-30T19:48:02.319ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29892024-08-30T19:48:02.370ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, time_created: 2024-08-30T19:43:17.286338Z, time_modified: 2024-08-30T19:43:17.286338Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
29902024-08-30T19:48:02.370ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
29912024-08-30T19:48:02.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29922024-08-30T19:48:02.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29932024-08-30T19:48:02.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29942024-08-30T19:48:02.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29952024-08-30T19:48:02.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29962024-08-30T19:48:02.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
29972024-08-30T19:48:02.407ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29982024-08-30T19:48:02.408ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bb8f354a-6f92-4f7e-a5dc-7026e7287388", "date": "Fri, 30 Aug 2024 19:48:01 GMT"} })
29992024-08-30T19:48:02.408ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
30002024-08-30T19:48:02.408ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30012024-08-30T19:48:02.409ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4db11b2c-0b7a-4e21-a088-ea9469048981", "content-length": "667", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
30022024-08-30T19:48:02.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30032024-08-30T19:48:02.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30042024-08-30T19:48:02.410ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b1e05d2e-18dd-4e74-a920-4f740bfafce0", "date": "Fri, 30 Aug 2024 19:48:02 GMT"} })
30052024-08-30T19:48:02.410ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
30062024-08-30T19:48:02.411ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 639.490001ms
30072024-08-30T19:48:02.411ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 639.500531ms iteration = 2 status = {}
30082024-08-30T19:48:02.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30092024-08-30T19:48:02.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30102024-08-30T19:48:02.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30112024-08-30T19:48:02.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30122024-08-30T19:48:02.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30132024-08-30T19:48:02.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30142024-08-30T19:48:02.425ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 654.549816ms iteration = 11 status = {}
30152024-08-30T19:48:02.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a84fe58b-d6a2-46fa-89cf-80e91ac9b18e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
30162024-08-30T19:48:02.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a84fe58b-d6a2-46fa-89cf-80e91ac9b18e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
30172024-08-30T19:48:02.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a84fe58b-d6a2-46fa-89cf-80e91ac9b18e response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
30182024-08-30T19:48:02.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f87eb14a-28c0-4bbf-bb3d-f2f2576539a5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30192024-08-30T19:48:02.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f87eb14a-28c0-4bbf-bb3d-f2f2576539a5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30202024-08-30T19:48:02.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f87eb14a-28c0-4bbf-bb3d-f2f2576539a5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30212024-08-30T19:48:03.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 787f3958-6140-4c48-a67a-110ea0f85f70 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30222024-08-30T19:48:03.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 787f3958-6140-4c48-a67a-110ea0f85f70 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30232024-08-30T19:48:03.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 787f3958-6140-4c48-a67a-110ea0f85f70 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30242024-08-30T19:48:04.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75a7ab12-d28b-49e6-b4b7-7d34765ebc0e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30252024-08-30T19:48:04.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75a7ab12-d28b-49e6-b4b7-7d34765ebc0e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30262024-08-30T19:48:04.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75a7ab12-d28b-49e6-b4b7-7d34765ebc0e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30272024-08-30T19:48:05.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0051fc07-e021-4f4c-a817-ce943045a0ac roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30282024-08-30T19:48:05.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0051fc07-e021-4f4c-a817-ce943045a0ac resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30292024-08-30T19:48:05.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0051fc07-e021-4f4c-a817-ce943045a0ac response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30302024-08-30T19:48:06.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d0c19f2f-d2bf-44be-93ce-e8e5b60b2b0b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30312024-08-30T19:48:07.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d0c19f2f-d2bf-44be-93ce-e8e5b60b2b0b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30322024-08-30T19:48:07.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d0c19f2f-d2bf-44be-93ce-e8e5b60b2b0b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30332024-08-30T19:48:08.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fa6b5f2c-1906-42ec-8667-9803ae9aeb2e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30342024-08-30T19:48:08.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fa6b5f2c-1906-42ec-8667-9803ae9aeb2e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30352024-08-30T19:48:08.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fa6b5f2c-1906-42ec-8667-9803ae9aeb2e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30362024-08-30T19:48:09.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2dabb714-b768-4cb1-96a8-8f03595aad30 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30372024-08-30T19:48:09.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2dabb714-b768-4cb1-96a8-8f03595aad30 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30382024-08-30T19:48:09.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2dabb714-b768-4cb1-96a8-8f03595aad30 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30392024-08-30T19:48:10.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1403 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 1240e834-4b12-4120-a00e-3265c3f3aba7 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
30402024-08-30T19:48:10.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bbb92b97-6d49-49d6-8059-c678781062d7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30412024-08-30T19:48:10.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bbb92b97-6d49-49d6-8059-c678781062d7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30422024-08-30T19:48:10.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bbb92b97-6d49-49d6-8059-c678781062d7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30432024-08-30T19:48:11.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dd4e2e5c-5bba-4ad4-b5fe-f9646e7c5155 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30442024-08-30T19:48:11.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dd4e2e5c-5bba-4ad4-b5fe-f9646e7c5155 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30452024-08-30T19:48:11.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dd4e2e5c-5bba-4ad4-b5fe-f9646e7c5155 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30462024-08-30T19:48:11.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
30472024-08-30T19:48:11.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
30482024-08-30T19:48:11.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30492024-08-30T19:48:11.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30502024-08-30T19:48:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30512024-08-30T19:48:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30522024-08-30T19:48:11.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30532024-08-30T19:48:11.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30542024-08-30T19:48:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30552024-08-30T19:48:11.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30562024-08-30T19:48:11.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30572024-08-30T19:48:11.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.837885ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30582024-08-30T19:48:11.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30592024-08-30T19:48:11.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30602024-08-30T19:48:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30612024-08-30T19:48:11.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30622024-08-30T19:48:11.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
30632024-08-30T19:48:11.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30642024-08-30T19:48:11.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30652024-08-30T19:48:11.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
30662024-08-30T19:48:11.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.859356ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
30672024-08-30T19:48:12.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7b207236-cf03-4890-af21-33374ade8b18 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30682024-08-30T19:48:12.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7b207236-cf03-4890-af21-33374ade8b18 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30692024-08-30T19:48:12.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7b207236-cf03-4890-af21-33374ade8b18 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30702024-08-30T19:48:12.310ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34785
30712024-08-30T19:48:12.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34785 req_id = 4dc44177-9539-4788-b6e8-a569cf78a67f roles = RoleSet { roles: {} } uri = /metrics/producers
30722024-08-30T19:48:12.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34785 req_id = 4dc44177-9539-4788-b6e8-a569cf78a67f resource = Database result = Ok(()) uri = /metrics/producers
30732024-08-30T19:48:12.344ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
30742024-08-30T19:48:12.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34785 req_id = 4dc44177-9539-4788-b6e8-a569cf78a67f roles = RoleSet { roles: {} } uri = /metrics/producers
30752024-08-30T19:48:12.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34785 req_id = 4dc44177-9539-4788-b6e8-a569cf78a67f resource = Database result = Ok(()) uri = /metrics/producers
30762024-08-30T19:48:12.383ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
30772024-08-30T19:48:12.383ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0264eaaa-92a6-4e9d-9080-e9dfd939c929", "date": "Fri, 30 Aug 2024 19:48:12 GMT"} })
30782024-08-30T19:48:12.383ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 1a27df0f-5b46-452b-9341-ffa1d189a587
30792024-08-30T19:48:12.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74039 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34785 req_id = 4dc44177-9539-4788-b6e8-a569cf78a67f response_code = 201 uri = /metrics/producers
30802024-08-30T19:48:13.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b7ff7773-43d9-4bef-8ca9-95f9d3209f94 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30812024-08-30T19:48:13.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b7ff7773-43d9-4bef-8ca9-95f9d3209f94 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30822024-08-30T19:48:13.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b7ff7773-43d9-4bef-8ca9-95f9d3209f94 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30832024-08-30T19:48:14.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a7194621-3887-41b1-b7c6-23b973052785 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30842024-08-30T19:48:14.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a7194621-3887-41b1-b7c6-23b973052785 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30852024-08-30T19:48:14.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a7194621-3887-41b1-b7c6-23b973052785 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30862024-08-30T19:48:15.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 43d6686d-25ab-4ad6-9f9a-95db8449a07e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30872024-08-30T19:48:15.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 43d6686d-25ab-4ad6-9f9a-95db8449a07e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30882024-08-30T19:48:15.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 43d6686d-25ab-4ad6-9f9a-95db8449a07e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30892024-08-30T19:48:16.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9836955f-702c-420b-8fc4-d09a98dc6ffc roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30902024-08-30T19:48:16.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9836955f-702c-420b-8fc4-d09a98dc6ffc resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30912024-08-30T19:48:16.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9836955f-702c-420b-8fc4-d09a98dc6ffc response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30922024-08-30T19:48:17.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39f16518-098c-488c-a156-52bf15de3679 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30932024-08-30T19:48:17.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39f16518-098c-488c-a156-52bf15de3679 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30942024-08-30T19:48:17.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 39f16518-098c-488c-a156-52bf15de3679 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30952024-08-30T19:48:18.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fe0925d8-db87-4fba-8d8a-64a91228474b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30962024-08-30T19:48:18.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fe0925d8-db87-4fba-8d8a-64a91228474b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30972024-08-30T19:48:18.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = fe0925d8-db87-4fba-8d8a-64a91228474b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30982024-08-30T19:48:19.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 068658cb-7a86-44b9-b90f-4844a1225833 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
30992024-08-30T19:48:19.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 068658cb-7a86-44b9-b90f-4844a1225833 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31002024-08-30T19:48:19.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 068658cb-7a86-44b9-b90f-4844a1225833 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31012024-08-30T19:48:20.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = dc218cf2-6496-4e76-a6ee-ce1f2f67d9c7 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
31022024-08-30T19:48:20.069ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
31032024-08-30T19:48:20.069ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
31042024-08-30T19:48:20.099ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
31052024-08-30T19:48:20.099ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60543
31062024-08-30T19:48:20.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60543 req_id = 9ecf4083-0ea7-405f-bbdb-81d4e0674442 roles = RoleSet { roles: {} } uri = /metrics/producers
31072024-08-30T19:48:20.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60543 req_id = 9ecf4083-0ea7-405f-bbdb-81d4e0674442 resource = Database result = Ok(()) uri = /metrics/producers
31082024-08-30T19:48:20.133ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
31092024-08-30T19:48:20.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60543 req_id = 9ecf4083-0ea7-405f-bbdb-81d4e0674442 roles = RoleSet { roles: {} } uri = /metrics/producers
31102024-08-30T19:48:20.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60543 req_id = 9ecf4083-0ea7-405f-bbdb-81d4e0674442 resource = Database result = Ok(()) uri = /metrics/producers
31112024-08-30T19:48:20.164ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
31122024-08-30T19:48:20.165ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "68791102-c5a3-4126-a30c-8725d3abe31e", "date": "Fri, 30 Aug 2024 19:48:20 GMT"} })
31132024-08-30T19:48:20.165ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
31142024-08-30T19:48:20.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66516 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60543 req_id = 9ecf4083-0ea7-405f-bbdb-81d4e0674442 response_code = 201 uri = /metrics/producers
31152024-08-30T19:48:20.166ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "9ecf4083-0ea7-405f-bbdb-81d4e0674442", "content-length": "41", "date": "Fri, 30 Aug 2024 19:48:20 GMT"} })
31162024-08-30T19:48:20.167ZDEBGnexus (producer-registration-task): registered with nexus successfully
31172024-08-30T19:48:20.167ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
31182024-08-30T19:48:20.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 64c6e4ce-7c77-4abd-85bb-418b281df0b9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31192024-08-30T19:48:20.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 64c6e4ce-7c77-4abd-85bb-418b281df0b9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31202024-08-30T19:48:20.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 64c6e4ce-7c77-4abd-85bb-418b281df0b9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31212024-08-30T19:48:21.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e5e8f695-95e5-434d-bdfe-965d44fb6692 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31222024-08-30T19:48:21.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e5e8f695-95e5-434d-bdfe-965d44fb6692 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31232024-08-30T19:48:21.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e5e8f695-95e5-434d-bdfe-965d44fb6692 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31242024-08-30T19:48:21.454ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36239
31252024-08-30T19:48:21.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36239 req_id = 0f3966d2-1dc3-4400-929c-fabee6febfb5 roles = RoleSet { roles: {} } uri = /metrics/producers
31262024-08-30T19:48:21.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36239 req_id = 0f3966d2-1dc3-4400-929c-fabee6febfb5 resource = Database result = Ok(()) uri = /metrics/producers
31272024-08-30T19:48:21.487ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
31282024-08-30T19:48:21.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36239 req_id = 0f3966d2-1dc3-4400-929c-fabee6febfb5 roles = RoleSet { roles: {} } uri = /metrics/producers
31292024-08-30T19:48:21.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36239 req_id = 0f3966d2-1dc3-4400-929c-fabee6febfb5 resource = Database result = Ok(()) uri = /metrics/producers
31302024-08-30T19:48:21.526ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
31312024-08-30T19:48:21.526ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1d08b50b-e293-411d-af17-231061be8a7f", "date": "Fri, 30 Aug 2024 19:48:21 GMT"} })
31322024-08-30T19:48:21.526ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 97bafd33-1efa-47dd-ad8d-79adc978f835
31332024-08-30T19:48:21.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73943 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36239 req_id = 0f3966d2-1dc3-4400-929c-fabee6febfb5 response_code = 201 uri = /metrics/producers
31342024-08-30T19:48:21.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
31352024-08-30T19:48:21.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
31362024-08-30T19:48:21.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31372024-08-30T19:48:21.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31382024-08-30T19:48:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31392024-08-30T19:48:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31402024-08-30T19:48:21.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31412024-08-30T19:48:21.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31422024-08-30T19:48:21.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31432024-08-30T19:48:21.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.539742ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31442024-08-30T19:48:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31452024-08-30T19:48:21.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31462024-08-30T19:48:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31472024-08-30T19:48:21.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31482024-08-30T19:48:21.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31492024-08-30T19:48:21.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31502024-08-30T19:48:21.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
31512024-08-30T19:48:21.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31522024-08-30T19:48:21.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31532024-08-30T19:48:21.792ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
31542024-08-30T19:48:21.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.736183ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
31552024-08-30T19:48:22.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 946aca61-104c-4dea-896f-a6f7054a69fc roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31562024-08-30T19:48:22.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 946aca61-104c-4dea-896f-a6f7054a69fc resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31572024-08-30T19:48:22.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 946aca61-104c-4dea-896f-a6f7054a69fc response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31582024-08-30T19:48:23.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8b5b906c-d7fe-476a-9e78-bb8676ddd63f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31592024-08-30T19:48:23.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8b5b906c-d7fe-476a-9e78-bb8676ddd63f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31602024-08-30T19:48:23.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8b5b906c-d7fe-476a-9e78-bb8676ddd63f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31612024-08-30T19:48:23.930ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61176
31622024-08-30T19:48:23.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61176 req_id = eb4cb989-9d7a-4f89-a266-034024a894ac roles = RoleSet { roles: {} } uri = /metrics/producers
31632024-08-30T19:48:23.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61176 req_id = eb4cb989-9d7a-4f89-a266-034024a894ac resource = Database result = Ok(()) uri = /metrics/producers
31642024-08-30T19:48:23.962ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
31652024-08-30T19:48:23.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61176 req_id = eb4cb989-9d7a-4f89-a266-034024a894ac roles = RoleSet { roles: {} } uri = /metrics/producers
31662024-08-30T19:48:23.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61176 req_id = eb4cb989-9d7a-4f89-a266-034024a894ac resource = Database result = Ok(()) uri = /metrics/producers
31672024-08-30T19:48:23.968ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
31682024-08-30T19:48:23.968ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d977db65-7478-49eb-8fb1-ff7b96af4194", "date": "Fri, 30 Aug 2024 19:48:23 GMT"} })
31692024-08-30T19:48:23.969ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = ed7080f3-1d98-4020-99f0-be3df73052de
31702024-08-30T19:48:23.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40011 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61176 req_id = eb4cb989-9d7a-4f89-a266-034024a894ac response_code = 201 uri = /metrics/producers
31712024-08-30T19:48:24.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1942a80d-61e4-4f31-aa3b-7d170cbc1e9d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31722024-08-30T19:48:24.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1942a80d-61e4-4f31-aa3b-7d170cbc1e9d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31732024-08-30T19:48:24.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1942a80d-61e4-4f31-aa3b-7d170cbc1e9d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31742024-08-30T19:48:25.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1fd85e10-42f8-44e9-bdee-b2ace11fb567 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31752024-08-30T19:48:25.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1fd85e10-42f8-44e9-bdee-b2ace11fb567 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31762024-08-30T19:48:25.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1fd85e10-42f8-44e9-bdee-b2ace11fb567 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31772024-08-30T19:48:26.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 13768e8b-09ad-4d79-9b7d-916d85ce05d6 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31782024-08-30T19:48:26.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 13768e8b-09ad-4d79-9b7d-916d85ce05d6 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31792024-08-30T19:48:26.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 13768e8b-09ad-4d79-9b7d-916d85ce05d6 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31802024-08-30T19:48:27.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1613f2dc-e8a7-4c4b-b621-b01991f20084 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31812024-08-30T19:48:27.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1613f2dc-e8a7-4c4b-b621-b01991f20084 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31822024-08-30T19:48:27.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1613f2dc-e8a7-4c4b-b621-b01991f20084 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31832024-08-30T19:48:28.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c7cb05eb-dc4d-458b-ba86-f1b9f42dad37 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31842024-08-30T19:48:28.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c7cb05eb-dc4d-458b-ba86-f1b9f42dad37 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31852024-08-30T19:48:28.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c7cb05eb-dc4d-458b-ba86-f1b9f42dad37 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31862024-08-30T19:48:29.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c5c5055a-32c3-42bd-b4ba-b024a06c6a61 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31872024-08-30T19:48:29.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c5c5055a-32c3-42bd-b4ba-b024a06c6a61 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31882024-08-30T19:48:29.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c5c5055a-32c3-42bd-b4ba-b024a06c6a61 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31892024-08-30T19:48:30.167ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 5ac0fb54-1cee-4b40-9261-b5418c2fd5e3 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
31902024-08-30T19:48:30.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 845d4223-2d1b-4bf6-a3de-859ca5d76111 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31912024-08-30T19:48:30.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 845d4223-2d1b-4bf6-a3de-859ca5d76111 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31922024-08-30T19:48:30.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 845d4223-2d1b-4bf6-a3de-859ca5d76111 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31932024-08-30T19:48:31.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9f22bb3e-3858-4083-b7a3-1ab5ba34229c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31942024-08-30T19:48:31.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9f22bb3e-3858-4083-b7a3-1ab5ba34229c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31952024-08-30T19:48:31.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9f22bb3e-3858-4083-b7a3-1ab5ba34229c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
31962024-08-30T19:48:31.771ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
31972024-08-30T19:48:31.771ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
31982024-08-30T19:48:31.771ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
31992024-08-30T19:48:31.771ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32002024-08-30T19:48:31.771ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32012024-08-30T19:48:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32022024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32032024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
32042024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
32052024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32062024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32072024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
32082024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
32092024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32102024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32112024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
32122024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32132024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
32142024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
32152024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32162024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32172024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32182024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
32192024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
32202024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32212024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32222024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
32232024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32242024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
32252024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32262024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
32272024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32282024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
32292024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32302024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
32312024-08-30T19:48:31.772ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32322024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32332024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32342024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32352024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32362024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32372024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32382024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32392024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32402024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32412024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32422024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32432024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32442024-08-30T19:48:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32452024-08-30T19:48:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32462024-08-30T19:48:31.780ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1198, tv_nsec: 86268336 } })
32472024-08-30T19:48:31.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32482024-08-30T19:48:31.781ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.27079ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32492024-08-30T19:48:31.781ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
32502024-08-30T19:48:31.781ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1198, tv_nsec: 87592739 } })
32512024-08-30T19:48:31.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32522024-08-30T19:48:31.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32532024-08-30T19:48:31.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.183799ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
32542024-08-30T19:48:31.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
32552024-08-30T19:48:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32562024-08-30T19:48:31.784ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32572024-08-30T19:48:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32582024-08-30T19:48:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32592024-08-30T19:48:31.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32602024-08-30T19:48:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32612024-08-30T19:48:31.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32622024-08-30T19:48:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32632024-08-30T19:48:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32642024-08-30T19:48:31.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32652024-08-30T19:48:31.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32662024-08-30T19:48:31.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32672024-08-30T19:48:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32682024-08-30T19:48:31.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32692024-08-30T19:48:31.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32702024-08-30T19:48:31.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32712024-08-30T19:48:31.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32722024-08-30T19:48:31.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32732024-08-30T19:48:31.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32742024-08-30T19:48:31.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32752024-08-30T19:48:31.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32762024-08-30T19:48:31.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32772024-08-30T19:48:31.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32782024-08-30T19:48:31.799ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1198, tv_nsec: 104705579 } })
32792024-08-30T19:48:31.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32802024-08-30T19:48:31.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
32812024-08-30T19:48:31.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32822024-08-30T19:48:31.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32832024-08-30T19:48:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32842024-08-30T19:48:31.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32852024-08-30T19:48:31.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32862024-08-30T19:48:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32872024-08-30T19:48:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32882024-08-30T19:48:31.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32892024-08-30T19:48:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32902024-08-30T19:48:31.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32912024-08-30T19:48:31.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32922024-08-30T19:48:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32932024-08-30T19:48:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32942024-08-30T19:48:31.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32952024-08-30T19:48:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32962024-08-30T19:48:31.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.451526ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
32972024-08-30T19:48:31.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-08-30T19:48:31.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.749813ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32992024-08-30T19:48:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
33002024-08-30T19:48:31.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33012024-08-30T19:48:31.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.756651ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33022024-08-30T19:48:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33032024-08-30T19:48:31.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33042024-08-30T19:48:31.833ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.374369ms iteration = 12 status = 0
33052024-08-30T19:48:31.833ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
33062024-08-30T19:48:31.833ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33072024-08-30T19:48:31.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33082024-08-30T19:48:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33092024-08-30T19:48:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33102024-08-30T19:48:31.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33112024-08-30T19:48:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33122024-08-30T19:48:31.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33132024-08-30T19:48:31.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33142024-08-30T19:48:31.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33152024-08-30T19:48:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33162024-08-30T19:48:31.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33172024-08-30T19:48:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33182024-08-30T19:48:31.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-08-30T19:48:31.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33202024-08-30T19:48:31.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33212024-08-30T19:48:31.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
33222024-08-30T19:48:31.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33232024-08-30T19:48:31.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33242024-08-30T19:48:31.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
33252024-08-30T19:48:31.864ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33262024-08-30T19:48:31.866ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d99a557d-2b80-4e0c-a56f-7523794bdfac", "content-length": "26", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
33272024-08-30T19:48:31.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33282024-08-30T19:48:31.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.787284ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
33292024-08-30T19:48:31.867ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33302024-08-30T19:48:31.871ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33312024-08-30T19:48:31.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.938336ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33322024-08-30T19:48:31.874ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
33332024-08-30T19:48:31.874ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33342024-08-30T19:48:31.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.614723ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
33352024-08-30T19:48:31.883ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
33362024-08-30T19:48:31.883ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33372024-08-30T19:48:31.883ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f44f2b37-3942-4cb4-b47a-04e956284c7f", "content-length": "26", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
33382024-08-30T19:48:31.883ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33392024-08-30T19:48:31.885ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33402024-08-30T19:48:31.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
33412024-08-30T19:48:31.888ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33422024-08-30T19:48:31.889ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5747d3c-2e44-40c1-82f3-31e2113115dd", "content-length": "26", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
33432024-08-30T19:48:31.889ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33442024-08-30T19:48:31.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
33452024-08-30T19:48:31.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.108293ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
33462024-08-30T19:48:31.941ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.14315ms iteration = 15 status = {"physical_disks_added":0}
33472024-08-30T19:48:31.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33482024-08-30T19:48:31.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33492024-08-30T19:48:31.959ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33502024-08-30T19:48:31.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33512024-08-30T19:48:31.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33522024-08-30T19:48:31.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33532024-08-30T19:48:31.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33542024-08-30T19:48:31.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33552024-08-30T19:48:31.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33562024-08-30T19:48:31.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33572024-08-30T19:48:31.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33582024-08-30T19:48:31.968ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
33592024-08-30T19:48:31.968ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 195.691034ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
33602024-08-30T19:48:31.983ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33612024-08-30T19:48:31.983ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71bba323-801f-45c6-89ea-54d001c4fe41", "content-length": "1", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
33622024-08-30T19:48:31.984ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33632024-08-30T19:48:31.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33642024-08-30T19:48:31.986ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.138005ms iteration = 12 status = null
33652024-08-30T19:48:32.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e50ccbf1-ae65-4b1d-9ff0-0cafca81f347", "content-length": "372", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
33662024-08-30T19:48:32.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33672024-08-30T19:48:32.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33682024-08-30T19:48:32.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33692024-08-30T19:48:32.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33702024-08-30T19:48:32.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33712024-08-30T19:48:32.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33722024-08-30T19:48:32.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33732024-08-30T19:48:32.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "df7c8f8a-b261-4d88-82fe-6d40286e0bfe", "content-length": "691", "date": "Fri, 30 Aug 2024 19:48:32 GMT"} })
33742024-08-30T19:48:32.063ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33752024-08-30T19:48:32.063ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33762024-08-30T19:48:32.063ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33772024-08-30T19:48:32.064ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 292.072035ms iteration = 12 status = {}
33782024-08-30T19:48:32.066ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33792024-08-30T19:48:32.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "53e4baa4-1d26-4f8f-970e-c61df74789d4", "date": "Fri, 30 Aug 2024 19:48:32 GMT"} })
33802024-08-30T19:48:32.069ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.175027ms iteration = 13 status = {}
33812024-08-30T19:48:32.080ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.588405ms iteration = 12 status = {}
33822024-08-30T19:48:32.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33832024-08-30T19:48:32.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33842024-08-30T19:48:32.139ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
33852024-08-30T19:48:32.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33862024-08-30T19:48:32.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33872024-08-30T19:48:32.148ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33882024-08-30T19:48:32.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8add97b9-4496-4bf5-bc50-63f81731d245", "content-length": "121", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
33892024-08-30T19:48:32.149ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33902024-08-30T19:48:32.149ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
33912024-08-30T19:48:32.149ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33922024-08-30T19:48:32.149ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33932024-08-30T19:48:32.149ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
33942024-08-30T19:48:32.149ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
33952024-08-30T19:48:32.149ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
33962024-08-30T19:48:32.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33972024-08-30T19:48:32.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33982024-08-30T19:48:32.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33992024-08-30T19:48:32.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bf884cbc-3efd-4d0f-9ab5-62f1d9cd4fee", "content-length": "2", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
34002024-08-30T19:48:32.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34012024-08-30T19:48:32.152ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9328e158-80dd-4f7d-8102-6f2c50fdaa84", "content-length": "52", "date": "Fri, 30 Aug 2024 19:48:31 GMT"} })
34022024-08-30T19:48:32.152ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
34032024-08-30T19:48:32.152ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34042024-08-30T19:48:32.250ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1675494c-66a9-4fcc-b461-a87817c2de14", "date": "Fri, 30 Aug 2024 19:48:32 GMT"} })
34052024-08-30T19:48:32.250ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
34062024-08-30T19:48:32.250ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34072024-08-30T19:48:32.250ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f81410c7-0217-4bd0-8ad7-cffb3abaed59", "content-length": "667", "date": "Fri, 30 Aug 2024 19:48:32 GMT"} })
34082024-08-30T19:48:32.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34092024-08-30T19:48:32.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34102024-08-30T19:48:32.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34112024-08-30T19:48:32.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34122024-08-30T19:48:32.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34132024-08-30T19:48:32.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34142024-08-30T19:48:32.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34152024-08-30T19:48:32.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34162024-08-30T19:48:32.265ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.078512ms iteration = 12 status = {}
34172024-08-30T19:48:32.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2a728bdc-6bb1-4ebe-8dda-618c48a57cd9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34182024-08-30T19:48:32.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2a728bdc-6bb1-4ebe-8dda-618c48a57cd9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34192024-08-30T19:48:32.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2a728bdc-6bb1-4ebe-8dda-618c48a57cd9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34202024-08-30T19:48:32.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 157c0156-11b6-49c7-bf99-c23ed287d1eb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
34212024-08-30T19:48:32.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 157c0156-11b6-49c7-bf99-c23ed287d1eb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
34222024-08-30T19:48:32.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 157c0156-11b6-49c7-bf99-c23ed287d1eb response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
34232024-08-30T19:48:32.868ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40712
34242024-08-30T19:48:32.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40712 req_id = bd34e562-6165-48c5-ae7d-2a9a6e867ac0 roles = RoleSet { roles: {} } uri = /metrics/producers
34252024-08-30T19:48:32.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40712 req_id = bd34e562-6165-48c5-ae7d-2a9a6e867ac0 resource = Database result = Ok(()) uri = /metrics/producers
34262024-08-30T19:48:32.902ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
34272024-08-30T19:48:32.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40712 req_id = bd34e562-6165-48c5-ae7d-2a9a6e867ac0 roles = RoleSet { roles: {} } uri = /metrics/producers
34282024-08-30T19:48:32.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40712 req_id = bd34e562-6165-48c5-ae7d-2a9a6e867ac0 resource = Database result = Ok(()) uri = /metrics/producers
34292024-08-30T19:48:32.931ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
34302024-08-30T19:48:32.932ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9ef174cb-ad2c-4d74-b739-04c838b98a9a", "date": "Fri, 30 Aug 2024 19:48:32 GMT"} })
34312024-08-30T19:48:32.932ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 215857b3-317f-4a74-b078-672feeaa0d1e
34322024-08-30T19:48:32.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64165 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40712 req_id = bd34e562-6165-48c5-ae7d-2a9a6e867ac0 response_code = 201 uri = /metrics/producers
34332024-08-30T19:48:33.154ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33237
34342024-08-30T19:48:33.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33237 req_id = e60102bf-33d3-4fc2-9c03-f86c86d46289 roles = RoleSet { roles: {} } uri = /metrics/producers
34352024-08-30T19:48:33.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33237 req_id = e60102bf-33d3-4fc2-9c03-f86c86d46289 resource = Database result = Ok(()) uri = /metrics/producers
34362024-08-30T19:48:33.187ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
34372024-08-30T19:48:33.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33237 req_id = e60102bf-33d3-4fc2-9c03-f86c86d46289 roles = RoleSet { roles: {} } uri = /metrics/producers
34382024-08-30T19:48:33.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33237 req_id = e60102bf-33d3-4fc2-9c03-f86c86d46289 resource = Database result = Ok(()) uri = /metrics/producers
34392024-08-30T19:48:33.218ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
34402024-08-30T19:48:33.218ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6fe74a06-1f6f-4f6d-881f-e4011c37337a", "date": "Fri, 30 Aug 2024 19:48:32 GMT"} })
34412024-08-30T19:48:33.218ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 289c9d10-fa69-4638-aac7-3cfc6b4e23be
34422024-08-30T19:48:33.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64606 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33237 req_id = e60102bf-33d3-4fc2-9c03-f86c86d46289 response_code = 201 uri = /metrics/producers
34432024-08-30T19:48:33.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5ecc6213-c4ef-4621-b346-dce7f97317ea roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34442024-08-30T19:48:33.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5ecc6213-c4ef-4621-b346-dce7f97317ea resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34452024-08-30T19:48:33.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5ecc6213-c4ef-4621-b346-dce7f97317ea response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34462024-08-30T19:48:34.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 90aaecbd-417b-4e8b-bacc-6471953c8686 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34472024-08-30T19:48:34.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 90aaecbd-417b-4e8b-bacc-6471953c8686 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34482024-08-30T19:48:34.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 90aaecbd-417b-4e8b-bacc-6471953c8686 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34492024-08-30T19:48:35.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a5c1e95b-42fe-42b8-af61-95f99e8191b0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34502024-08-30T19:48:35.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a5c1e95b-42fe-42b8-af61-95f99e8191b0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34512024-08-30T19:48:35.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a5c1e95b-42fe-42b8-af61-95f99e8191b0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34522024-08-30T19:48:36.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 44847b62-dd67-498f-8f39-e62ece8711fb roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34532024-08-30T19:48:36.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 44847b62-dd67-498f-8f39-e62ece8711fb resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34542024-08-30T19:48:36.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 44847b62-dd67-498f-8f39-e62ece8711fb response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34552024-08-30T19:48:37.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 13985367-3df7-47c4-b499-0ed87bcf7ab2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34562024-08-30T19:48:37.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 13985367-3df7-47c4-b499-0ed87bcf7ab2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34572024-08-30T19:48:37.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 13985367-3df7-47c4-b499-0ed87bcf7ab2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34582024-08-30T19:48:38.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 22a658a1-f652-4175-8d81-664b7aacfb80 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34592024-08-30T19:48:38.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 22a658a1-f652-4175-8d81-664b7aacfb80 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34602024-08-30T19:48:38.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 22a658a1-f652-4175-8d81-664b7aacfb80 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34612024-08-30T19:48:39.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3a16f62b-c190-4612-a6e9-5ce8e145fe98 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34622024-08-30T19:48:39.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3a16f62b-c190-4612-a6e9-5ce8e145fe98 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34632024-08-30T19:48:39.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3a16f62b-c190-4612-a6e9-5ce8e145fe98 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34642024-08-30T19:48:40.167ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1337 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 7e5bbcae-2569-4b83-883e-12c77b040063 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
34652024-08-30T19:48:40.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 50903620-d8bc-44e0-9471-9325b67a8883 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34662024-08-30T19:48:40.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 50903620-d8bc-44e0-9471-9325b67a8883 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34672024-08-30T19:48:40.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 50903620-d8bc-44e0-9471-9325b67a8883 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34682024-08-30T19:48:41.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4277b28f-5624-4a33-9ceb-baa4d1056443 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34692024-08-30T19:48:41.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4277b28f-5624-4a33-9ceb-baa4d1056443 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34702024-08-30T19:48:41.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4277b28f-5624-4a33-9ceb-baa4d1056443 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34712024-08-30T19:48:41.771ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
34722024-08-30T19:48:41.771ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
34732024-08-30T19:48:41.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34742024-08-30T19:48:41.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34752024-08-30T19:48:41.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34762024-08-30T19:48:41.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34772024-08-30T19:48:41.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782024-08-30T19:48:41.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34792024-08-30T19:48:41.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34802024-08-30T19:48:41.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34812024-08-30T19:48:41.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34822024-08-30T19:48:41.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34832024-08-30T19:48:41.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842024-08-30T19:48:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
34852024-08-30T19:48:41.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34862024-08-30T19:48:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34872024-08-30T19:48:41.793ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
34882024-08-30T19:48:41.793ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.396685ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
34892024-08-30T19:48:41.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34902024-08-30T19:48:41.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34912024-08-30T19:48:41.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.636388ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34922024-08-30T19:48:42.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ab99263e-84ba-44e7-9d1f-fb4e5f29dcec roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34932024-08-30T19:48:42.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ab99263e-84ba-44e7-9d1f-fb4e5f29dcec resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34942024-08-30T19:48:42.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ab99263e-84ba-44e7-9d1f-fb4e5f29dcec response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34952024-08-30T19:48:43.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8cac3e60-9770-43b3-a28c-dc816759f65d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34962024-08-30T19:48:43.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8cac3e60-9770-43b3-a28c-dc816759f65d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34972024-08-30T19:48:43.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8cac3e60-9770-43b3-a28c-dc816759f65d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
34982024-08-30T19:48:44.530ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35475
34992024-08-30T19:48:44.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35475 req_id = 7d206271-6f10-47fe-8fb1-0108e5762673 roles = RoleSet { roles: {} } uri = /metrics/producers
35002024-08-30T19:48:44.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35475 req_id = 7d206271-6f10-47fe-8fb1-0108e5762673 resource = Database result = Ok(()) uri = /metrics/producers
35012024-08-30T19:48:44.562ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
35022024-08-30T19:48:44.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35475 req_id = 7d206271-6f10-47fe-8fb1-0108e5762673 roles = RoleSet { roles: {} } uri = /metrics/producers
35032024-08-30T19:48:44.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35475 req_id = 7d206271-6f10-47fe-8fb1-0108e5762673 resource = Database result = Ok(()) uri = /metrics/producers
35042024-08-30T19:48:44.592ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
35052024-08-30T19:48:44.592ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "26401505-09f8-4de2-aaa1-2b44c0d749d8", "date": "Fri, 30 Aug 2024 19:48:44 GMT"} })
35062024-08-30T19:48:44.592ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = e392e9bc-bfce-46aa-93ab-b26313dd4677
35072024-08-30T19:48:44.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63039 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35475 req_id = 7d206271-6f10-47fe-8fb1-0108e5762673 response_code = 201 uri = /metrics/producers
35082024-08-30T19:48:44.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5d0f2905-5e3c-49e1-abf6-e01913f0a84e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35092024-08-30T19:48:44.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5d0f2905-5e3c-49e1-abf6-e01913f0a84e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35102024-08-30T19:48:44.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5d0f2905-5e3c-49e1-abf6-e01913f0a84e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35112024-08-30T19:48:45.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a500e614-1a9d-4280-b153-f9b62295b822 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35122024-08-30T19:48:45.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a500e614-1a9d-4280-b153-f9b62295b822 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35132024-08-30T19:48:45.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a500e614-1a9d-4280-b153-f9b62295b822 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35142024-08-30T19:48:46.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b0c9b292-a4c5-454f-9eff-dfb3d61d5f75 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35152024-08-30T19:48:46.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b0c9b292-a4c5-454f-9eff-dfb3d61d5f75 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35162024-08-30T19:48:46.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b0c9b292-a4c5-454f-9eff-dfb3d61d5f75 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35172024-08-30T19:48:47.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1df34c3b-9f83-40ca-a442-aeab94c41956 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35182024-08-30T19:48:47.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1df34c3b-9f83-40ca-a442-aeab94c41956 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35192024-08-30T19:48:47.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1df34c3b-9f83-40ca-a442-aeab94c41956 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35202024-08-30T19:48:48.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d7367cf4-be82-4f42-be89-125fa508ff36 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35212024-08-30T19:48:48.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d7367cf4-be82-4f42-be89-125fa508ff36 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35222024-08-30T19:48:48.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d7367cf4-be82-4f42-be89-125fa508ff36 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35232024-08-30T19:48:49.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec65bd77-5bb0-409f-acfd-3a100b6458b4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35242024-08-30T19:48:49.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec65bd77-5bb0-409f-acfd-3a100b6458b4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35252024-08-30T19:48:49.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec65bd77-5bb0-409f-acfd-3a100b6458b4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35262024-08-30T19:48:50.167ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1415 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 7a73d80e-4c87-41c5-a8ad-58dd356c6571 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
35272024-08-30T19:48:50.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23ec58e1-566e-4399-88b6-1921c1b01406 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35282024-08-30T19:48:50.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23ec58e1-566e-4399-88b6-1921c1b01406 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35292024-08-30T19:48:50.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23ec58e1-566e-4399-88b6-1921c1b01406 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35302024-08-30T19:48:51.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
35312024-08-30T19:48:51.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
35322024-08-30T19:48:51.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35332024-08-30T19:48:51.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35342024-08-30T19:48:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35352024-08-30T19:48:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35362024-08-30T19:48:51.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372024-08-30T19:48:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35382024-08-30T19:48:51.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35392024-08-30T19:48:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35402024-08-30T19:48:51.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35412024-08-30T19:48:51.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35422024-08-30T19:48:51.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35432024-08-30T19:48:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
35442024-08-30T19:48:51.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35452024-08-30T19:48:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35462024-08-30T19:48:51.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
35472024-08-30T19:48:51.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.729063ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
35482024-08-30T19:48:51.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35492024-08-30T19:48:51.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35502024-08-30T19:48:51.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.459037ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35512024-08-30T19:48:51.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3eda02d0-5c1c-4378-acd4-dbe6414ba844 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35522024-08-30T19:48:51.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3eda02d0-5c1c-4378-acd4-dbe6414ba844 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35532024-08-30T19:48:51.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3eda02d0-5c1c-4378-acd4-dbe6414ba844 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35542024-08-30T19:48:53.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c008ae9-c870-405c-87f0-29595db84cc9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35552024-08-30T19:48:53.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c008ae9-c870-405c-87f0-29595db84cc9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35562024-08-30T19:48:53.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c008ae9-c870-405c-87f0-29595db84cc9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35572024-08-30T19:48:54.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75c3b1ef-eb1e-4ff1-9146-8a9ef95ef370 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35582024-08-30T19:48:54.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75c3b1ef-eb1e-4ff1-9146-8a9ef95ef370 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35592024-08-30T19:48:54.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75c3b1ef-eb1e-4ff1-9146-8a9ef95ef370 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35602024-08-30T19:48:55.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7daa386e-e4da-4f06-aaad-76572c65855a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35612024-08-30T19:48:55.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7daa386e-e4da-4f06-aaad-76572c65855a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35622024-08-30T19:48:55.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7daa386e-e4da-4f06-aaad-76572c65855a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35632024-08-30T19:48:56.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f1b0a424-9682-47ab-9ea3-47dafa898f42 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35642024-08-30T19:48:56.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f1b0a424-9682-47ab-9ea3-47dafa898f42 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35652024-08-30T19:48:56.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f1b0a424-9682-47ab-9ea3-47dafa898f42 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35662024-08-30T19:48:57.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e2ac66a-f1b9-4293-922c-eebb15b4287e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35672024-08-30T19:48:57.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e2ac66a-f1b9-4293-922c-eebb15b4287e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35682024-08-30T19:48:57.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e2ac66a-f1b9-4293-922c-eebb15b4287e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35692024-08-30T19:48:58.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = eaef56b4-6f4f-44a1-8c8b-7c45bd63df73 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35702024-08-30T19:48:58.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = eaef56b4-6f4f-44a1-8c8b-7c45bd63df73 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35712024-08-30T19:48:58.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = eaef56b4-6f4f-44a1-8c8b-7c45bd63df73 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35722024-08-30T19:48:59.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5de36bc5-120e-4ed6-bbb4-c57d0ca1c6a1 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35732024-08-30T19:48:59.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5de36bc5-120e-4ed6-bbb4-c57d0ca1c6a1 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35742024-08-30T19:48:59.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5de36bc5-120e-4ed6-bbb4-c57d0ca1c6a1 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35752024-08-30T19:49:00.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cff8844f-8010-419d-ab31-95fc0326cba6 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35762024-08-30T19:49:00.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cff8844f-8010-419d-ab31-95fc0326cba6 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35772024-08-30T19:49:00.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cff8844f-8010-419d-ab31-95fc0326cba6 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35782024-08-30T19:49:00.167ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1355 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = ef463ddb-5e32-48a1-b3bb-210e3aeda2ce response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
35792024-08-30T19:49:01.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0a1b72c3-e9fb-4049-9130-f0b67d5961ed roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35802024-08-30T19:49:01.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0a1b72c3-e9fb-4049-9130-f0b67d5961ed resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35812024-08-30T19:49:01.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0a1b72c3-e9fb-4049-9130-f0b67d5961ed response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
35822024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
35832024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
35842024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
35852024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35862024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35872024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
35882024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
35892024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35902024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
35912024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35922024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
35932024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
35942024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35952024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
35962024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
35972024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35982024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
35992024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
36002024-08-30T19:49:01.771ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-30 19:39:01.771828924 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
36012024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
36022024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
36032024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
36042024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36052024-08-30T19:49:01.771ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
36062024-08-30T19:49:01.771ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
36072024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36082024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
36092024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
36102024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36112024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
36122024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36132024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
36142024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36152024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
36162024-08-30T19:49:01.772ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
36172024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36182024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
36192024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36202024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
36212024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36222024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
36232024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36242024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36252024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
36262024-08-30T19:49:01.772ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25
36272024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.13\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25"}
36282024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
36292024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36302024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
36312024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36322024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36332024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
36342024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
36352024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36362024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
36372024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36382024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36392024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
36402024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
36412024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
36422024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36432024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
36442024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36452024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36462024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36472024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
36482024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36492024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36502024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36512024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36522024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36532024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
36542024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36552024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36562024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36572024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36582024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36592024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36602024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36612024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36622024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36632024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36642024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36652024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36662024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36672024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
36682024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36692024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36702024-08-30T19:49:01.772ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36712024-08-30T19:49:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36722024-08-30T19:49:01.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36732024-08-30T19:49:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36742024-08-30T19:49:01.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36752024-08-30T19:49:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36762024-08-30T19:49:01.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36772024-08-30T19:49:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36782024-08-30T19:49:01.774ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5636b10-76ec-4aa4-8bd4-1f95780813df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1228, tv_nsec: 79435856 } })
36792024-08-30T19:49:01.774ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8b642bba-10a6-428b-9af7-48d5f8622e03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5d7b957-0082-4dc3-b742-d6e7150a43c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1228, tv_nsec: 79473587 } })
36802024-08-30T19:49:01.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36812024-08-30T19:49:01.776ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.248504ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36822024-08-30T19:49:01.776ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
36832024-08-30T19:49:01.776ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.58285ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
36842024-08-30T19:49:01.776ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-30 19:39:01.771828924 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
36852024-08-30T19:49:01.777ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.172941ms iteration = 7 status = {"expiration":"2024-08-30T19:39:01.771828924Z","pruned":[]}
36862024-08-30T19:49:01.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36872024-08-30T19:49:01.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36882024-08-30T19:49:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36892024-08-30T19:49:01.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1228, tv_nsec: 83121131 } })
36902024-08-30T19:49:01.777ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
36912024-08-30T19:49:01.777ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.098737ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
36922024-08-30T19:49:01.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36932024-08-30T19:49:01.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36942024-08-30T19:49:01.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1228, tv_nsec: 84631047 } })
36952024-08-30T19:49:01.779ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
36962024-08-30T19:49:01.779ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972024-08-30T19:49:01.780ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36982024-08-30T19:49:01.780ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36992024-08-30T19:49:01.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37002024-08-30T19:49:01.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
37012024-08-30T19:49:01.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37022024-08-30T19:49:01.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37032024-08-30T19:49:01.782ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37042024-08-30T19:49:01.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
37052024-08-30T19:49:01.782ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37062024-08-30T19:49:01.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37072024-08-30T19:49:01.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
37082024-08-30T19:49:01.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37092024-08-30T19:49:01.784ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37102024-08-30T19:49:01.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37112024-08-30T19:49:01.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122024-08-30T19:49:01.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37132024-08-30T19:49:01.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37142024-08-30T19:49:01.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37152024-08-30T19:49:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37162024-08-30T19:49:01.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37172024-08-30T19:49:01.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37182024-08-30T19:49:01.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37192024-08-30T19:49:01.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.068225ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
37202024-08-30T19:49:01.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37212024-08-30T19:49:01.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37222024-08-30T19:49:01.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37232024-08-30T19:49:01.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37242024-08-30T19:49:01.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37252024-08-30T19:49:01.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37262024-08-30T19:49:01.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37272024-08-30T19:49:01.795ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.245808ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
37282024-08-30T19:49:01.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37292024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37302024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37312024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37322024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37332024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37342024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37352024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37362024-08-30T19:49:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37372024-08-30T19:49:01.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382024-08-30T19:49:01.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37392024-08-30T19:49:01.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37402024-08-30T19:49:01.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37412024-08-30T19:49:01.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37422024-08-30T19:49:01.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37432024-08-30T19:49:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37442024-08-30T19:49:01.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37452024-08-30T19:49:01.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37462024-08-30T19:49:01.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37472024-08-30T19:49:01.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37482024-08-30T19:49:01.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37492024-08-30T19:49:01.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37502024-08-30T19:49:01.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.652756ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37512024-08-30T19:49:01.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37522024-08-30T19:49:01.809ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
37532024-08-30T19:49:01.809ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
37542024-08-30T19:49:01.809ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 37.61176ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
37552024-08-30T19:49:01.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 37.560989ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
37562024-08-30T19:49:01.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37572024-08-30T19:49:01.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37582024-08-30T19:49:01.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37592024-08-30T19:49:01.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37602024-08-30T19:49:01.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37612024-08-30T19:49:01.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37622024-08-30T19:49:01.820ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1228, tv_nsec: 125743099 } })
37632024-08-30T19:49:01.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37642024-08-30T19:49:01.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37652024-08-30T19:49:01.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
37662024-08-30T19:49:01.822ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37672024-08-30T19:49:01.822ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.722001ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37682024-08-30T19:49:01.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37692024-08-30T19:49:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37702024-08-30T19:49:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
37712024-08-30T19:49:01.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37722024-08-30T19:49:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37732024-08-30T19:49:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
37742024-08-30T19:49:01.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37752024-08-30T19:49:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37762024-08-30T19:49:01.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37772024-08-30T19:49:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37782024-08-30T19:49:01.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.352829ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
37792024-08-30T19:49:01.833ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
37802024-08-30T19:49:01.833ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37812024-08-30T19:49:01.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37822024-08-30T19:49:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37832024-08-30T19:49:01.835ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
37842024-08-30T19:49:01.835ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.176849ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
37852024-08-30T19:49:01.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37862024-08-30T19:49:01.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37872024-08-30T19:49:01.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37882024-08-30T19:49:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37892024-08-30T19:49:01.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37902024-08-30T19:49:01.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37912024-08-30T19:49:01.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37922024-08-30T19:49:01.842ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37932024-08-30T19:49:01.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37942024-08-30T19:49:01.843ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
37952024-08-30T19:49:01.843ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
37962024-08-30T19:49:01.843ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 71.220249ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
37972024-08-30T19:49:01.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37982024-08-30T19:49:01.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37992024-08-30T19:49:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38002024-08-30T19:49:01.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38012024-08-30T19:49:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38022024-08-30T19:49:01.849ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 77.257655ms iteration = 4 status = {"nsuccess":5}
38032024-08-30T19:49:01.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38042024-08-30T19:49:01.851ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
38052024-08-30T19:49:01.851ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
38062024-08-30T19:49:01.851ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
38072024-08-30T19:49:01.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38082024-08-30T19:49:01.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38092024-08-30T19:49:01.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38102024-08-30T19:49:01.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38112024-08-30T19:49:01.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38122024-08-30T19:49:01.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38132024-08-30T19:49:01.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38142024-08-30T19:49:01.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38152024-08-30T19:49:01.856ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
38162024-08-30T19:49:01.856ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
38172024-08-30T19:49:01.856ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
38182024-08-30T19:49:01.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38192024-08-30T19:49:01.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38202024-08-30T19:49:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38212024-08-30T19:49:01.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38222024-08-30T19:49:01.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38232024-08-30T19:49:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38242024-08-30T19:49:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38252024-08-30T19:49:01.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38262024-08-30T19:49:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38272024-08-30T19:49:01.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38282024-08-30T19:49:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38292024-08-30T19:49:01.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.795176ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38302024-08-30T19:49:01.875ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
38312024-08-30T19:49:01.875ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38322024-08-30T19:49:01.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.868932ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
38332024-08-30T19:49:01.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38342024-08-30T19:49:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
38352024-08-30T19:49:01.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38362024-08-30T19:49:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38372024-08-30T19:49:01.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
38382024-08-30T19:49:01.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38392024-08-30T19:49:01.956ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38402024-08-30T19:49:01.956ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f0a8978d-8187-4d05-ae4e-9732ec88cfdb", "content-length": "26", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
38412024-08-30T19:49:01.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38422024-08-30T19:49:01.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38432024-08-30T19:49:01.966ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
38442024-08-30T19:49:02.064ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
38452024-08-30T19:49:02.065ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e48c308d-738e-4ecd-83f2-1a2e6fe9b2b5", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38462024-08-30T19:49:02.065ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38472024-08-30T19:49:02.066ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1dc9c41f-d442-4463-8459-c218cf5c96ec", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38482024-08-30T19:49:02.066ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38492024-08-30T19:49:02.069ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38502024-08-30T19:49:02.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 297.625283ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
38512024-08-30T19:49:02.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38522024-08-30T19:49:02.073ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38532024-08-30T19:49:02.074ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1537cde8-943e-4085-977f-f593c08e3d9f", "content-length": "26", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
38542024-08-30T19:49:02.074ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38552024-08-30T19:49:02.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38562024-08-30T19:49:02.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
38572024-08-30T19:49:02.109ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38582024-08-30T19:49:02.110ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fcf4d10-f962-468f-9cb9-739286485342", "content-length": "26", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
38592024-08-30T19:49:02.110ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38602024-08-30T19:49:02.112ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
38612024-08-30T19:49:02.123ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 351.792023ms iteration = 13 status = {}
38622024-08-30T19:49:02.193ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38632024-08-30T19:49:02.193ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "36b1b76f-b25a-484b-af30-219d9bf9f242", "content-length": "372", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
38642024-08-30T19:49:02.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38652024-08-30T19:49:02.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38662024-08-30T19:49:02.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38672024-08-30T19:49:02.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38682024-08-30T19:49:02.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38692024-08-30T19:49:02.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38702024-08-30T19:49:02.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38712024-08-30T19:49:02.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38722024-08-30T19:49:02.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38732024-08-30T19:49:02.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38742024-08-30T19:49:02.199ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752024-08-30T19:49:02.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38762024-08-30T19:49:02.201ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38772024-08-30T19:49:02.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38782024-08-30T19:49:02.202ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 430.485334ms iteration = 13 status = 0
38792024-08-30T19:49:02.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38802024-08-30T19:49:02.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38812024-08-30T19:49:02.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38822024-08-30T19:49:02.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d910deab-9b66-4580-b3f0-c9e98c2d1e76 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
38832024-08-30T19:49:02.203ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
38842024-08-30T19:49:02.203ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
38852024-08-30T19:49:02.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38862024-08-30T19:49:02.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d910deab-9b66-4580-b3f0-c9e98c2d1e76 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
38872024-08-30T19:49:02.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38882024-08-30T19:49:02.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38892024-08-30T19:49:02.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38902024-08-30T19:49:02.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38912024-08-30T19:49:02.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d910deab-9b66-4580-b3f0-c9e98c2d1e76 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
38922024-08-30T19:49:02.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38932024-08-30T19:49:02.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38942024-08-30T19:49:02.208ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38952024-08-30T19:49:02.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "89179e5f-5fce-4fd3-a695-76a00cd40f5d", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
38962024-08-30T19:49:02.216ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 444.042851ms iteration = 14 status = {}
38972024-08-30T19:49:02.221ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
38982024-08-30T19:49:02.221ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 0 version = 2
38992024-08-30T19:49:02.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39002024-08-30T19:49:02.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39012024-08-30T19:49:02.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 449.939145ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39022024-08-30T19:49:02.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39032024-08-30T19:49:02.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39042024-08-30T19:49:02.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39052024-08-30T19:49:02.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39062024-08-30T19:49:02.227ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 1 version = 2
39072024-08-30T19:49:02.227ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
39082024-08-30T19:49:02.227ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-30 19:43:18.363870 UTC dns_group = external generation = 2
39092024-08-30T19:49:02.227ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 456.193715ms iteration = 8 status = {"generation":2}
39102024-08-30T19:49:02.238ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-30T19:42:58.455639Z, time_modified: 2024-08-30T19:42:58.455639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }) }
39112024-08-30T19:49:02.239ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 467.259839ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]}},"default_endpoint":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
39122024-08-30T19:49:02.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132024-08-30T19:49:02.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39142024-08-30T19:49:02.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39152024-08-30T19:49:02.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39162024-08-30T19:49:02.250ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
39172024-08-30T19:49:02.250ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
39182024-08-30T19:49:02.250ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-30 19:43:16.884603 UTC dns_group = internal generation = 1
39192024-08-30T19:49:02.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 478.481886ms iteration = 8 status = {"generation":1}
39202024-08-30T19:49:02.270ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
39212024-08-30T19:49:02.280ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 508.251438ms iteration = 16 status = {"physical_disks_added":0}
39222024-08-30T19:49:02.343ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
39232024-08-30T19:49:02.343ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2d637ef2-6031-4135-a8b5-76937b30e0e8", "content-length": "1", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
39242024-08-30T19:49:02.345ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39252024-08-30T19:49:02.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39262024-08-30T19:49:02.347ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 575.883975ms iteration = 13 status = null
39272024-08-30T19:49:02.409ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
39282024-08-30T19:49:02.409ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de6eb49c-758c-4e9c-a3db-f8ede93fbaa7", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39292024-08-30T19:49:02.409ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39302024-08-30T19:49:02.411ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2e34b3e4-fa3a-48d7-9bc0-c7b032c90de7", "date": "Fri, 30 Aug 2024 19:49:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39312024-08-30T19:49:02.411ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39322024-08-30T19:49:02.412ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3cce2cee-816c-4b9e-8419-6cd174216ead", "date": "Fri, 30 Aug 2024 19:49:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39332024-08-30T19:49:02.412ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39342024-08-30T19:49:02.414ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39352024-08-30T19:49:02.414ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 642.88588ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
39362024-08-30T19:49:02.456ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39372024-08-30T19:49:02.457ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77ad1177-0e17-424b-a24e-99a1b199409b", "content-length": "691", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
39382024-08-30T19:49:02.457ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
39392024-08-30T19:49:02.457ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
39402024-08-30T19:49:02.457ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39412024-08-30T19:49:02.458ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 686.504056ms iteration = 13 status = {}
39422024-08-30T19:49:02.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39432024-08-30T19:49:02.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39442024-08-30T19:49:02.481ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
39452024-08-30T19:49:02.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39462024-08-30T19:49:02.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39472024-08-30T19:49:02.490ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39482024-08-30T19:49:02.491ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d063ba4-8ec5-4581-86a1-59e9049a0a42", "content-length": "121", "date": "Fri, 30 Aug 2024 19:49:02 GMT"} })
39492024-08-30T19:49:02.491ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
39502024-08-30T19:49:02.491ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
39512024-08-30T19:49:02.491ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39522024-08-30T19:49:02.491ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39532024-08-30T19:49:02.491ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
39542024-08-30T19:49:02.491ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
39552024-08-30T19:49:02.491ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
39562024-08-30T19:49:02.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39572024-08-30T19:49:02.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39582024-08-30T19:49:02.493ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39592024-08-30T19:49:02.494ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "829f99cb-37e5-4f61-981c-98407d30b8b9", "content-length": "2", "date": "Fri, 30 Aug 2024 19:49:02 GMT"} })
39602024-08-30T19:49:02.494ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39612024-08-30T19:49:02.494ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ff33381-08f6-48cb-9ab8-d7e1cc5bd466", "content-length": "52", "date": "Fri, 30 Aug 2024 19:49:02 GMT"} })
39622024-08-30T19:49:02.494ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
39632024-08-30T19:49:02.494ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39642024-08-30T19:49:02.594ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ccbf676d-f1f4-4eb0-85d3-8dda53068710", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
39652024-08-30T19:49:02.594ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
39662024-08-30T19:49:02.594ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39672024-08-30T19:49:02.594ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6286ed22-8c96-494c-b668-fb7b7e065047", "content-length": "667", "date": "Fri, 30 Aug 2024 19:49:01 GMT"} })
39682024-08-30T19:49:02.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39692024-08-30T19:49:02.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39702024-08-30T19:49:02.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39712024-08-30T19:49:02.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39722024-08-30T19:49:02.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39732024-08-30T19:49:02.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39742024-08-30T19:49:02.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39752024-08-30T19:49:02.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39762024-08-30T19:49:02.611ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 838.779588ms iteration = 13 status = {}
39772024-08-30T19:49:02.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a4e81b9c-947a-4587-a42b-97ae7292aeea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
39782024-08-30T19:49:02.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a4e81b9c-947a-4587-a42b-97ae7292aeea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
39792024-08-30T19:49:02.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = a4e81b9c-947a-4587-a42b-97ae7292aeea response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
39802024-08-30T19:49:03.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6c9631aa-e48a-4091-8a9e-6a7c25a11819 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39812024-08-30T19:49:03.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6c9631aa-e48a-4091-8a9e-6a7c25a11819 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39822024-08-30T19:49:03.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6c9631aa-e48a-4091-8a9e-6a7c25a11819 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39832024-08-30T19:49:04.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8728ea87-1041-44e4-8ed0-b9e910b52601 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39842024-08-30T19:49:04.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8728ea87-1041-44e4-8ed0-b9e910b52601 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39852024-08-30T19:49:04.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8728ea87-1041-44e4-8ed0-b9e910b52601 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39862024-08-30T19:49:05.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8a57137b-4420-4c16-bd87-eb7a18dd8a5f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39872024-08-30T19:49:05.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8a57137b-4420-4c16-bd87-eb7a18dd8a5f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39882024-08-30T19:49:05.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8a57137b-4420-4c16-bd87-eb7a18dd8a5f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39892024-08-30T19:49:06.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17681858-fff9-44b5-a3bb-de8efcc8eada roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39902024-08-30T19:49:06.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17681858-fff9-44b5-a3bb-de8efcc8eada resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39912024-08-30T19:49:06.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17681858-fff9-44b5-a3bb-de8efcc8eada response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39922024-08-30T19:49:07.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e51f8372-9615-4fb3-af06-2500aa4fc16a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39932024-08-30T19:49:07.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e51f8372-9615-4fb3-af06-2500aa4fc16a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39942024-08-30T19:49:07.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e51f8372-9615-4fb3-af06-2500aa4fc16a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39952024-08-30T19:49:08.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2abd804e-5189-4f4b-827d-1b80c6c7879e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39962024-08-30T19:49:08.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2abd804e-5189-4f4b-827d-1b80c6c7879e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39972024-08-30T19:49:08.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2abd804e-5189-4f4b-827d-1b80c6c7879e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39982024-08-30T19:49:09.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b61f95db-913d-487f-af44-772c6cb7ff9f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
39992024-08-30T19:49:09.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b61f95db-913d-487f-af44-772c6cb7ff9f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40002024-08-30T19:49:09.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b61f95db-913d-487f-af44-772c6cb7ff9f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40012024-08-30T19:49:10.167ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1393 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 0542a4db-90d5-4080-a386-af8ca7869c8a response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
40022024-08-30T19:49:10.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 45ec3119-bbf2-4eec-a1f3-0c0196cae4b4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40032024-08-30T19:49:10.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 45ec3119-bbf2-4eec-a1f3-0c0196cae4b4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40042024-08-30T19:49:10.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 45ec3119-bbf2-4eec-a1f3-0c0196cae4b4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40052024-08-30T19:49:11.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f008b561-f8af-4652-8273-0e6a3de525f5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40062024-08-30T19:49:11.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f008b561-f8af-4652-8273-0e6a3de525f5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40072024-08-30T19:49:11.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f008b561-f8af-4652-8273-0e6a3de525f5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40082024-08-30T19:49:11.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
40092024-08-30T19:49:11.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
40102024-08-30T19:49:11.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40112024-08-30T19:49:11.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40122024-08-30T19:49:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40132024-08-30T19:49:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40142024-08-30T19:49:11.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152024-08-30T19:49:11.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40162024-08-30T19:49:11.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40172024-08-30T19:49:11.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40182024-08-30T19:49:11.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40192024-08-30T19:49:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40202024-08-30T19:49:11.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40212024-08-30T19:49:11.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40222024-08-30T19:49:11.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40232024-08-30T19:49:11.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
40242024-08-30T19:49:11.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40252024-08-30T19:49:11.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40262024-08-30T19:49:11.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
40272024-08-30T19:49:11.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.799284ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
40282024-08-30T19:49:11.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.322665ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40292024-08-30T19:49:12.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf90ff65-d075-4655-ba7b-55dce1ffffd0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40302024-08-30T19:49:12.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf90ff65-d075-4655-ba7b-55dce1ffffd0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40312024-08-30T19:49:12.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf90ff65-d075-4655-ba7b-55dce1ffffd0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40322024-08-30T19:49:13.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b6e60f41-d293-4fb3-8e83-ab27028149c6 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40332024-08-30T19:49:13.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b6e60f41-d293-4fb3-8e83-ab27028149c6 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40342024-08-30T19:49:13.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b6e60f41-d293-4fb3-8e83-ab27028149c6 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40352024-08-30T19:49:14.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c452c4c-cac2-4cd3-8f62-189ae9f2a86b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40362024-08-30T19:49:14.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c452c4c-cac2-4cd3-8f62-189ae9f2a86b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40372024-08-30T19:49:14.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c452c4c-cac2-4cd3-8f62-189ae9f2a86b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40382024-08-30T19:49:15.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 46bb7c7e-4bb0-4a28-8251-5f314bd90493 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40392024-08-30T19:49:15.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 46bb7c7e-4bb0-4a28-8251-5f314bd90493 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40402024-08-30T19:49:15.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 46bb7c7e-4bb0-4a28-8251-5f314bd90493 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40412024-08-30T19:49:16.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e387ed21-7569-4298-947e-939fb2dd3278 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40422024-08-30T19:49:16.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e387ed21-7569-4298-947e-939fb2dd3278 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40432024-08-30T19:49:16.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e387ed21-7569-4298-947e-939fb2dd3278 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40442024-08-30T19:49:17.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 414d6570-669d-40a8-b952-82a01919e089 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40452024-08-30T19:49:17.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 414d6570-669d-40a8-b952-82a01919e089 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40462024-08-30T19:49:17.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 414d6570-669d-40a8-b952-82a01919e089 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40472024-08-30T19:49:18.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 209286cf-20dc-40fe-8e83-fde04b6589e9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40482024-08-30T19:49:18.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 209286cf-20dc-40fe-8e83-fde04b6589e9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40492024-08-30T19:49:18.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 209286cf-20dc-40fe-8e83-fde04b6589e9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40502024-08-30T19:49:19.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a4241435-6330-464d-9bbb-023b4667660a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40512024-08-30T19:49:19.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a4241435-6330-464d-9bbb-023b4667660a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40522024-08-30T19:49:19.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a4241435-6330-464d-9bbb-023b4667660a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40532024-08-30T19:49:20.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 1d721945-13d4-488a-97be-7188e00f556a response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
40542024-08-30T19:49:20.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75dda951-39a3-46f5-a7f6-f1881e9c0993 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40552024-08-30T19:49:20.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75dda951-39a3-46f5-a7f6-f1881e9c0993 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40562024-08-30T19:49:20.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75dda951-39a3-46f5-a7f6-f1881e9c0993 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40572024-08-30T19:49:21.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b11ad1de-e049-440f-8c01-a9c912ecee76 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40582024-08-30T19:49:21.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b11ad1de-e049-440f-8c01-a9c912ecee76 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40592024-08-30T19:49:21.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b11ad1de-e049-440f-8c01-a9c912ecee76 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40602024-08-30T19:49:21.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
40612024-08-30T19:49:21.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
40622024-08-30T19:49:21.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40632024-08-30T19:49:21.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40642024-08-30T19:49:21.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40652024-08-30T19:49:21.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40662024-08-30T19:49:21.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672024-08-30T19:49:21.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40682024-08-30T19:49:21.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40692024-08-30T19:49:21.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40702024-08-30T19:49:21.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40712024-08-30T19:49:21.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40722024-08-30T19:49:21.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732024-08-30T19:49:21.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
40742024-08-30T19:49:21.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40752024-08-30T19:49:21.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40762024-08-30T19:49:21.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
40772024-08-30T19:49:21.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.455206ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
40782024-08-30T19:49:21.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40792024-08-30T19:49:21.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40802024-08-30T19:49:21.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.357234ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40812024-08-30T19:49:22.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5723bf8e-cb59-46aa-af07-1cb2f3e12398 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40822024-08-30T19:49:22.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5723bf8e-cb59-46aa-af07-1cb2f3e12398 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40832024-08-30T19:49:22.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5723bf8e-cb59-46aa-af07-1cb2f3e12398 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40842024-08-30T19:49:23.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9cd632a8-d93c-4981-b510-95edb1611212 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40852024-08-30T19:49:23.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9cd632a8-d93c-4981-b510-95edb1611212 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40862024-08-30T19:49:23.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9cd632a8-d93c-4981-b510-95edb1611212 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40872024-08-30T19:49:23.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 3fa07804-65a2-4249-b4b1-f73499354839 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
40882024-08-30T19:49:23.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 3fa07804-65a2-4249-b4b1-f73499354839 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
40892024-08-30T19:49:23.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 3fa07804-65a2-4249-b4b1-f73499354839 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
40902024-08-30T19:49:23.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = e9ba0884-c66f-47cc-82c7-01a8d53d7c17 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
40912024-08-30T19:49:23.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = e9ba0884-c66f-47cc-82c7-01a8d53d7c17 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
40922024-08-30T19:49:23.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = e9ba0884-c66f-47cc-82c7-01a8d53d7c17 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
40932024-08-30T19:49:24.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f7011c57-3805-4aac-bfc6-3aca0d39a031 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40942024-08-30T19:49:24.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f7011c57-3805-4aac-bfc6-3aca0d39a031 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40952024-08-30T19:49:24.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f7011c57-3805-4aac-bfc6-3aca0d39a031 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40962024-08-30T19:49:25.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e0cbf256-d044-4e2e-9098-63e894635ed4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40972024-08-30T19:49:25.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e0cbf256-d044-4e2e-9098-63e894635ed4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40982024-08-30T19:49:25.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e0cbf256-d044-4e2e-9098-63e894635ed4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
40992024-08-30T19:49:26.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4456e7fd-6544-49f0-a8c6-35845084765c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41002024-08-30T19:49:26.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4456e7fd-6544-49f0-a8c6-35845084765c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41012024-08-30T19:49:26.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4456e7fd-6544-49f0-a8c6-35845084765c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41022024-08-30T19:49:27.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3803ec97-2b4b-4e43-9085-28cf4a2e7d34 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41032024-08-30T19:49:27.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3803ec97-2b4b-4e43-9085-28cf4a2e7d34 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41042024-08-30T19:49:27.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3803ec97-2b4b-4e43-9085-28cf4a2e7d34 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41052024-08-30T19:49:28.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 70f7da34-dbfb-457d-96a7-0613fe6891ba roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41062024-08-30T19:49:28.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 70f7da34-dbfb-457d-96a7-0613fe6891ba resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41072024-08-30T19:49:28.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 70f7da34-dbfb-457d-96a7-0613fe6891ba response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41082024-08-30T19:49:29.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6a5a3d92-bc6f-433a-82ac-092ea0ae5418 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41092024-08-30T19:49:29.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6a5a3d92-bc6f-433a-82ac-092ea0ae5418 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41102024-08-30T19:49:29.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6a5a3d92-bc6f-433a-82ac-092ea0ae5418 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41112024-08-30T19:49:30.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1555 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 9c32a86e-3e8d-46ab-8c2e-3b50362b80c8 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
41122024-08-30T19:49:30.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9b303b07-7743-41a3-946a-d3c8e094e951 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41132024-08-30T19:49:30.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9b303b07-7743-41a3-946a-d3c8e094e951 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41142024-08-30T19:49:30.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9b303b07-7743-41a3-946a-d3c8e094e951 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
41152024-08-30T19:49:31.747ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6959a2dd-4b54-4f9d-836e-c3ec359682eb uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-30T19:49:31.734864731Z }
41162024-08-30T19:49:31.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6959a2dd-4b54-4f9d-836e-c3ec359682eb roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
41172024-08-30T19:49:31.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6959a2dd-4b54-4f9d-836e-c3ec359682eb resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
41182024-08-30T19:49:31.772ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
41192024-08-30T19:49:31.772ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
41202024-08-30T19:49:31.772ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41212024-08-30T19:49:31.772ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
41222024-08-30T19:49:31.772ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41232024-08-30T19:49:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41242024-08-30T19:49:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41252024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
41262024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
41272024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41282024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41292024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
41302024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41312024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
41322024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41332024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
41342024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41352024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41362024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
41372024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41382024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
41392024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41402024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
41412024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41422024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
41432024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
41442024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41452024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41462024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
41472024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41482024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
41492024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41502024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
41512024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41522024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
41532024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41542024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41552024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41562024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41572024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41582024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41592024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41602024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41612024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41622024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41632024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41642024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41652024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41662024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41672024-08-30T19:49:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41682024-08-30T19:49:31.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.069244ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
41692024-08-30T19:49:31.776ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.327196ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41702024-08-30T19:49:31.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712024-08-30T19:49:31.776ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1258, tv_nsec: 81681476 } })
41722024-08-30T19:49:31.776ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1258, tv_nsec: 81696536 } })
41732024-08-30T19:49:31.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
41742024-08-30T19:49:31.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41752024-08-30T19:49:31.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
41762024-08-30T19:49:31.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41772024-08-30T19:49:31.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41782024-08-30T19:49:31.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41792024-08-30T19:49:31.779ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:64938
41802024-08-30T19:49:31.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64938 req_id = e0646550-b463-4ad2-af30-a130bf11e527 roles = RoleSet { roles: {} } uri = /metrics/producers
41812024-08-30T19:49:31.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64938 req_id = e0646550-b463-4ad2-af30-a130bf11e527 resource = Database result = Ok(()) uri = /metrics/producers
41822024-08-30T19:49:31.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41832024-08-30T19:49:31.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41842024-08-30T19:49:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41852024-08-30T19:49:31.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41862024-08-30T19:49:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41872024-08-30T19:49:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41882024-08-30T19:49:31.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41892024-08-30T19:49:31.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41902024-08-30T19:49:31.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41912024-08-30T19:49:31.783ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41922024-08-30T19:49:31.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41932024-08-30T19:49:31.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942024-08-30T19:49:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41952024-08-30T19:49:31.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41962024-08-30T19:49:31.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41972024-08-30T19:49:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41982024-08-30T19:49:31.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41992024-08-30T19:49:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42002024-08-30T19:49:31.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42012024-08-30T19:49:31.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42022024-08-30T19:49:31.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42032024-08-30T19:49:31.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42042024-08-30T19:49:31.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42052024-08-30T19:49:31.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42062024-08-30T19:49:31.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42072024-08-30T19:49:31.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42082024-08-30T19:49:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42092024-08-30T19:49:31.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69003 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6959a2dd-4b54-4f9d-836e-c3ec359682eb response_code = 204 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
42102024-08-30T19:49:31.805ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d6ad9340-7b15-47d4-bec5-c61d7cc950d9 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-30T19:49:31.805552721Z }
42112024-08-30T19:49:31.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d6ad9340-7b15-47d4-bec5-c61d7cc950d9 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
42122024-08-30T19:49:31.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d6ad9340-7b15-47d4-bec5-c61d7cc950d9 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
42132024-08-30T19:49:31.810ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
42142024-08-30T19:49:31.810ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42152024-08-30T19:49:31.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42162024-08-30T19:49:31.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42172024-08-30T19:49:31.817ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42182024-08-30T19:49:31.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.613383ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
42192024-08-30T19:49:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42202024-08-30T19:49:31.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42212024-08-30T19:49:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42222024-08-30T19:49:31.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.462096ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42232024-08-30T19:49:31.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42242024-08-30T19:49:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42252024-08-30T19:49:31.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42262024-08-30T19:49:31.849ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42272024-08-30T19:49:31.850ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a56ef4e1-6278-4a6a-adfb-c128b79a0fa1", "content-length": "26", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
42282024-08-30T19:49:31.850ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42292024-08-30T19:49:31.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42302024-08-30T19:49:31.851ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42312024-08-30T19:49:31.852ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "95ee7761-516f-4cdc-90a4-c24c356fdd0f", "content-length": "26", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
42322024-08-30T19:49:31.852ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42332024-08-30T19:49:31.852ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42342024-08-30T19:49:31.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42352024-08-30T19:49:31.853ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:57809
42362024-08-30T19:49:31.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57809 req_id = 17c3041e-329e-4ad4-8ac9-536a9deb8003 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
42372024-08-30T19:49:31.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57809 req_id = 17c3041e-329e-4ad4-8ac9-536a9deb8003 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
42382024-08-30T19:49:31.881ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
42392024-08-30T19:49:31.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64938 req_id = e0646550-b463-4ad2-af30-a130bf11e527 roles = RoleSet { roles: {} } uri = /metrics/producers
42402024-08-30T19:49:31.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64938 req_id = e0646550-b463-4ad2-af30-a130bf11e527 resource = Database result = Ok(()) uri = /metrics/producers
42412024-08-30T19:49:31.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42422024-08-30T19:49:31.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42432024-08-30T19:49:31.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42442024-08-30T19:49:31.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42452024-08-30T19:49:31.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1258, tv_nsec: 192160664 } })
42462024-08-30T19:49:31.887ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
42472024-08-30T19:49:31.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 36551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57809 req_id = 17c3041e-329e-4ad4-8ac9-536a9deb8003 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
42482024-08-30T19:49:31.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42492024-08-30T19:49:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42502024-08-30T19:49:31.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42512024-08-30T19:49:31.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42522024-08-30T19:49:31.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42532024-08-30T19:49:31.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42542024-08-30T19:49:31.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 153.466023ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42552024-08-30T19:49:31.927ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42562024-08-30T19:49:31.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42572024-08-30T19:49:31.929ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
42582024-08-30T19:49:31.929ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42592024-08-30T19:49:31.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.425905ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
42602024-08-30T19:49:31.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42612024-08-30T19:49:31.937ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
42622024-08-30T19:49:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
42632024-08-30T19:49:31.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42642024-08-30T19:49:31.937ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5886e4ea-e39a-4b2d-920f-a8dcd8678971", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
42652024-08-30T19:49:31.937ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 177df596-2bc8-436c-a193-ec68f297307f
42662024-08-30T19:49:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42672024-08-30T19:49:31.939ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42682024-08-30T19:49:31.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 159960 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64938 req_id = e0646550-b463-4ad2-af30-a130bf11e527 response_code = 201 uri = /metrics/producers
42692024-08-30T19:49:31.939ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "caf8f29d-cb5e-497b-8988-9a64bdf922a7", "content-length": "2", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
42702024-08-30T19:49:31.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.166023ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
42712024-08-30T19:49:31.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42722024-08-30T19:49:31.941ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42732024-08-30T19:49:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42742024-08-30T19:49:31.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42752024-08-30T19:49:31.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42762024-08-30T19:49:31.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42772024-08-30T19:49:31.945ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 173.289091ms iteration = 14 status = {}
42782024-08-30T19:49:31.945ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 173.337172ms iteration = 14 status = null
42792024-08-30T19:49:31.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 141487 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d6ad9340-7b15-47d4-bec5-c61d7cc950d9 response_code = 204 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
42802024-08-30T19:49:31.948ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
42812024-08-30T19:49:31.948ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 174.684105ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
42822024-08-30T19:49:31.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42832024-08-30T19:49:31.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
42842024-08-30T19:49:31.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42852024-08-30T19:49:31.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42862024-08-30T19:49:31.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
42872024-08-30T19:49:31.961ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42882024-08-30T19:49:31.961ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a514891d-c8ce-46db-9b59-3ae380c5519f", "content-length": "26", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
42892024-08-30T19:49:31.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42902024-08-30T19:49:31.962ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 189.037748ms iteration = 14 status = 0
42912024-08-30T19:49:31.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.050118ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42922024-08-30T19:49:31.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
42932024-08-30T19:49:32.023ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40/state
42942024-08-30T19:49:32.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42952024-08-30T19:49:32.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42962024-08-30T19:49:32.030ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42972024-08-30T19:49:32.039ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 266.434935ms iteration = 17 status = {"physical_disks_added":0}
42982024-08-30T19:49:32.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42992024-08-30T19:49:32.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43002024-08-30T19:49:32.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43012024-08-30T19:49:32.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43022024-08-30T19:49:32.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43032024-08-30T19:49:32.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43042024-08-30T19:49:32.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43052024-08-30T19:49:32.088ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
43062024-08-30T19:49:32.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43072024-08-30T19:49:32.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43082024-08-30T19:49:32.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b71b739d-0020-47f1-a026-688230bfcf06", "content-length": "130", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43092024-08-30T19:49:32.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b2dc418a-149c-4f97-926c-8a772c6c02c8", "content-length": "583", "date": "Fri, 30 Aug 2024 19:49:32 GMT"} })
43102024-08-30T19:49:32.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43112024-08-30T19:49:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43122024-08-30T19:49:32.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43132024-08-30T19:49:32.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43142024-08-30T19:49:32.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43152024-08-30T19:49:32.092ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 177df596-2bc8-436c-a193-ec68f297307f state = Running
43162024-08-30T19:49:32.092ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1853 instance_id = 177df596-2bc8-436c-a193-ec68f297307f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-30T19:49:31.805552721Z }
43172024-08-30T19:49:32.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 177df596-2bc8-436c-a193-ec68f297307f roles = RoleSet { roles: {} }
43182024-08-30T19:49:32.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 177df596-2bc8-436c-a193-ec68f297307f resource = Database result = Ok(())
43192024-08-30T19:49:32.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43202024-08-30T19:49:32.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43212024-08-30T19:49:32.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43222024-08-30T19:49:32.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43232024-08-30T19:49:32.098ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43242024-08-30T19:49:32.098ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc288978-e304-435c-911d-13df3340c384", "content-length": "121", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43252024-08-30T19:49:32.098ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
43262024-08-30T19:49:32.098ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
43272024-08-30T19:49:32.098ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43282024-08-30T19:49:32.098ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43292024-08-30T19:49:32.098ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
43302024-08-30T19:49:32.098ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
43312024-08-30T19:49:32.098ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
43322024-08-30T19:49:32.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43332024-08-30T19:49:32.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43342024-08-30T19:49:32.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43352024-08-30T19:49:32.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43362024-08-30T19:49:32.100ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43372024-08-30T19:49:32.100ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6faa748a-01c7-468f-b331-df7acb418753", "content-length": "2", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43382024-08-30T19:49:32.100ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43392024-08-30T19:49:32.100ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96dd5161-929d-4c7e-9a59-028bd847c98e", "content-length": "52", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43402024-08-30T19:49:32.100ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
43412024-08-30T19:49:32.100ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43422024-08-30T19:49:32.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43432024-08-30T19:49:32.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43442024-08-30T19:49:32.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43452024-08-30T19:49:32.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43462024-08-30T19:49:32.108ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43472024-08-30T19:49:32.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b8324ffe-ef00-408c-88f9-2af3e3c8a60a", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43482024-08-30T19:49:32.110ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.604474ms iteration = 15 status = {}
43492024-08-30T19:49:32.120ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
43502024-08-30T19:49:32.120ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 346.959589ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
43512024-08-30T19:49:32.178ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43522024-08-30T19:49:32.179ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f7fa8912-f464-4276-afbc-3ffa04db0fb3", "content-length": "810", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43532024-08-30T19:49:32.179ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 250, 253, 123])), vni: Vni(6417893) }} sled = buskin
43542024-08-30T19:49:32.179ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43552024-08-30T19:49:32.179ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43562024-08-30T19:49:32.180ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 407.197965ms iteration = 14 status = {}
43572024-08-30T19:49:32.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "62504c8e-0752-4735-8d7e-49adbaaef60d", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43582024-08-30T19:49:32.268ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
43592024-08-30T19:49:32.268ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43602024-08-30T19:49:32.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2d25789-129c-46ed-8830-f37fb25380e3", "content-length": "667", "date": "Fri, 30 Aug 2024 19:49:31 GMT"} })
43612024-08-30T19:49:32.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43622024-08-30T19:49:32.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43632024-08-30T19:49:32.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43642024-08-30T19:49:32.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43652024-08-30T19:49:32.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43662024-08-30T19:49:32.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43672024-08-30T19:49:32.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43682024-08-30T19:49:32.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43692024-08-30T19:49:32.285ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 511.685829ms iteration = 14 status = {}
43702024-08-30T19:49:32.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6b1899cd-737a-48cd-a92d-c7bf3b9dd7e3 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43712024-08-30T19:49:32.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6b1899cd-737a-48cd-a92d-c7bf3b9dd7e3 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43722024-08-30T19:49:32.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6b1899cd-737a-48cd-a92d-c7bf3b9dd7e3 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43732024-08-30T19:49:33.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae6f4d78-db5f-486e-ba83-0b8dc88e101b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43742024-08-30T19:49:33.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae6f4d78-db5f-486e-ba83-0b8dc88e101b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43752024-08-30T19:49:33.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae6f4d78-db5f-486e-ba83-0b8dc88e101b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43762024-08-30T19:49:34.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 15863cb5-84e2-4f97-8d87-7f14cd9ae90e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43772024-08-30T19:49:34.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 15863cb5-84e2-4f97-8d87-7f14cd9ae90e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43782024-08-30T19:49:34.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 15863cb5-84e2-4f97-8d87-7f14cd9ae90e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43792024-08-30T19:49:35.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b6f28f7d-e371-4d1a-9322-abf57e373a0a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43802024-08-30T19:49:35.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b6f28f7d-e371-4d1a-9322-abf57e373a0a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43812024-08-30T19:49:35.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b6f28f7d-e371-4d1a-9322-abf57e373a0a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43822024-08-30T19:49:37.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5b258c7f-d4de-451a-9a57-859f5db5e974 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43832024-08-30T19:49:37.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5b258c7f-d4de-451a-9a57-859f5db5e974 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43842024-08-30T19:49:37.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5b258c7f-d4de-451a-9a57-859f5db5e974 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43852024-08-30T19:49:38.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7bee48a7-9be6-45ac-92dd-7d25a5f26012 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43862024-08-30T19:49:38.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7bee48a7-9be6-45ac-92dd-7d25a5f26012 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43872024-08-30T19:49:38.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7bee48a7-9be6-45ac-92dd-7d25a5f26012 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43882024-08-30T19:49:39.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5ca13ac2-cf8f-49bb-86e1-4dd3e88b05d2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43892024-08-30T19:49:39.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5ca13ac2-cf8f-49bb-86e1-4dd3e88b05d2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43902024-08-30T19:49:39.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5ca13ac2-cf8f-49bb-86e1-4dd3e88b05d2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43912024-08-30T19:49:40.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e432fe1a-14c5-456a-b03e-8c4b3993468a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43922024-08-30T19:49:40.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e432fe1a-14c5-456a-b03e-8c4b3993468a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43932024-08-30T19:49:40.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e432fe1a-14c5-456a-b03e-8c4b3993468a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
43942024-08-30T19:49:40.171ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3852 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = c9f64e55-734f-4921-b4bb-343ab381cd47 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
43952024-08-30T19:49:40.884ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4bca68cc-5f70-4e65-bb9a-57aade74e1a8 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-30T19:49:40.884202502Z }
43962024-08-30T19:49:40.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4bca68cc-5f70-4e65-bb9a-57aade74e1a8 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
43972024-08-30T19:49:40.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4bca68cc-5f70-4e65-bb9a-57aade74e1a8 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
43982024-08-30T19:49:40.942ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:160 retry_after (ms) = 21 transaction = vmm_and_migration_update_runtime
43992024-08-30T19:49:40.974ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:116 transaction = vmm_and_migration_update_runtime
44002024-08-30T19:49:40.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90109 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4bca68cc-5f70-4e65-bb9a-57aade74e1a8 response_code = 204 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44012024-08-30T19:49:41.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a504df30-8694-4184-8254-b9325f690576 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44022024-08-30T19:49:41.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a504df30-8694-4184-8254-b9325f690576 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44032024-08-30T19:49:41.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a504df30-8694-4184-8254-b9325f690576 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44042024-08-30T19:49:41.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
44052024-08-30T19:49:41.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
44062024-08-30T19:49:41.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44072024-08-30T19:49:41.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44082024-08-30T19:49:41.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44092024-08-30T19:49:41.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44102024-08-30T19:49:41.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44112024-08-30T19:49:41.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44122024-08-30T19:49:41.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44132024-08-30T19:49:41.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44142024-08-30T19:49:41.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44152024-08-30T19:49:41.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44162024-08-30T19:49:41.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44172024-08-30T19:49:41.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44182024-08-30T19:49:41.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.589969ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44192024-08-30T19:49:41.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44202024-08-30T19:49:41.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
44212024-08-30T19:49:41.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44222024-08-30T19:49:41.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44232024-08-30T19:49:41.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
44242024-08-30T19:49:41.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.498658ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
44252024-08-30T19:49:41.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 00846a73-2e8d-4758-a63c-5101fbb048fb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
44262024-08-30T19:49:41.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 00846a73-2e8d-4758-a63c-5101fbb048fb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
44272024-08-30T19:49:41.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 00846a73-2e8d-4758-a63c-5101fbb048fb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
44282024-08-30T19:49:41.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 44f9be2e-24be-4a9c-900a-e98a71e1257c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
44292024-08-30T19:49:41.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 44f9be2e-24be-4a9c-900a-e98a71e1257c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
44302024-08-30T19:49:41.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 44f9be2e-24be-4a9c-900a-e98a71e1257c response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
44312024-08-30T19:49:42.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 58d0c8ec-5404-4710-ad94-328c2f0e0888 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44322024-08-30T19:49:42.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 58d0c8ec-5404-4710-ad94-328c2f0e0888 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44332024-08-30T19:49:42.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 58d0c8ec-5404-4710-ad94-328c2f0e0888 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44342024-08-30T19:49:42.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = f1665a08-4697-4973-af86-591a4617c39e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
44352024-08-30T19:49:42.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = f1665a08-4697-4973-af86-591a4617c39e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
44362024-08-30T19:49:42.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = f1665a08-4697-4973-af86-591a4617c39e response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
44372024-08-30T19:49:43.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 96b7362f-7866-4929-b1ba-67dabf58622b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44382024-08-30T19:49:43.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 96b7362f-7866-4929-b1ba-67dabf58622b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44392024-08-30T19:49:43.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 96b7362f-7866-4929-b1ba-67dabf58622b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
44402024-08-30T19:49:43.366ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-30T19:49:43.366545999Z }
44412024-08-30T19:49:43.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44422024-08-30T19:49:43.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44432024-08-30T19:49:43.381ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_needs_update = true
44442024-08-30T19:49:43.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44452024-08-30T19:49:43.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44462024-08-30T19:49:43.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44472024-08-30T19:49:43.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44482024-08-30T19:49:43.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44492024-08-30T19:49:43.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44502024-08-30T19:49:43.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44512024-08-30T19:49:43.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44522024-08-30T19:49:43.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44532024-08-30T19:49:43.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44542024-08-30T19:49:43.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44552024-08-30T19:49:43.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44562024-08-30T19:49:43.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44572024-08-30T19:49:43.397ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: aa09ea70-5935-4726-aa8b-daae29285c7a, lookup_type: ById(aa09ea70-5935-4726-aa8b-daae29285c7a) }, key: 0ba5e404-8695-42aa-a849-7665ae57f2aa, lookup_type: ById(0ba5e404-8695-42aa-a849-7665ae57f2aa) }, key: 177df596-2bc8-436c-a193-ec68f297307f, lookup_type: ById(177df596-2bc8-436c-a193-ec68f297307f) } result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44582024-08-30T19:49:43.397ZINFOnexus (dropshot_internal): starting update saga for 177df596-2bc8-436c-a193-ec68f297307f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1349 instance_id = 177df596-2bc8-436c-a193-ec68f297307f local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-30T19:49:43.366545999Z }
44592024-08-30T19:49:43.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 30472 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7cb2a6db-62cf-48bd-abb2-469666ebc4c0 response_code = 204 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44602024-08-30T19:49:43.397ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 918fb259-8a8f-4b2d-9792-5d983c3bd52b uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-30T19:49:43.366545999Z }
44612024-08-30T19:49:43.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 918fb259-8a8f-4b2d-9792-5d983c3bd52b roles = RoleSet { roles: {} } uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44622024-08-30T19:49:43.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 918fb259-8a8f-4b2d-9792-5d983c3bd52b resource = Database result = Ok(()) uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44632024-08-30T19:49:43.400ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update
44642024-08-30T19:49:43.400ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"177df596-2bc8-436c-a193-ec68f297307f","lookup_type":{"ById":"177df596-2bc8-436c-a193-ec68f297307f"},"parent":{"key":"0ba5e404-8695-42aa-a849-7665ae57f2aa","lookup_type":{"ById":"0ba5e404-8695-42aa-a849-7665ae57f2aa"},"parent":{"key":"aa09ea70-5935-4726-aa8b-daae29285c7a","lookup_type":{"ById":"aa09ea70-5935-4726-aa8b-daae29285c7a"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
44652024-08-30T19:49:43.400ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update
44662024-08-30T19:49:43.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4223 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 918fb259-8a8f-4b2d-9792-5d983c3bd52b response_code = 204 uri = /vmms/abc56fb8-ba04-4cc7-859c-561136aa9b40
44672024-08-30T19:49:43.426ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update
44682024-08-30T19:49:43.426ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
44692024-08-30T19:49:43.426ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
44702024-08-30T19:49:43.426ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
44712024-08-30T19:49:43.433ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
44722024-08-30T19:49:43.433ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
44732024-08-30T19:49:43.437ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
44742024-08-30T19:49:43.437ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
44752024-08-30T19:49:43.443ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
44762024-08-30T19:49:43.443ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e198f43d-4e2e-4bcc-8b3c-f82171317613")) node_id = 0 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
44772024-08-30T19:49:43.447ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
44782024-08-30T19:49:43.447ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
44792024-08-30T19:49:43.452ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update
44802024-08-30T19:49:43.452ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44812024-08-30T19:49:43.453ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44822024-08-30T19:49:43.454ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44832024-08-30T19:49:43.455ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44842024-08-30T19:49:43.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44852024-08-30T19:49:43.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44862024-08-30T19:49:43.458ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44872024-08-30T19:49:43.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44882024-08-30T19:49:43.459ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44892024-08-30T19:49:43.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44902024-08-30T19:49:43.483ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44912024-08-30T19:49:43.483ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44922024-08-30T19:49:43.484ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44932024-08-30T19:49:43.487ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: aa09ea70-5935-4726-aa8b-daae29285c7a, lookup_type: ById(aa09ea70-5935-4726-aa8b-daae29285c7a) }, key: 0ba5e404-8695-42aa-a849-7665ae57f2aa, lookup_type: ById(0ba5e404-8695-42aa-a849-7665ae57f2aa) }, key: 177df596-2bc8-436c-a193-ec68f297307f, lookup_type: ById(177df596-2bc8-436c-a193-ec68f297307f) } result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44942024-08-30T19:49:43.487ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance updater_id = e198f43d-4e2e-4bcc-8b3c-f82171317613
44952024-08-30T19:49:43.487ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44962024-08-30T19:49:43.487ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44972024-08-30T19:49:43.499ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance updater_id = e198f43d-4e2e-4bcc-8b3c-f82171317613
44982024-08-30T19:49:43.499ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
44992024-08-30T19:49:43.499ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance
45002024-08-30T19:49:43.503ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 177df596-2bc8-436c-a193-ec68f297307f locked_gen = Generation(Generation(2)) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = LockInstance updater_id = e198f43d-4e2e-4bcc-8b3c-f82171317613
45012024-08-30T19:49:43.503ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45022024-08-30T19:49:43.503ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e198f43d-4e2e-4bcc-8b3c-f82171317613")}) node_id = 1 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
45032024-08-30T19:49:43.509ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45042024-08-30T19:49:43.509ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
45052024-08-30T19:49:43.518ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45062024-08-30T19:49:43.518ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45072024-08-30T19:49:43.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45082024-08-30T19:49:43.519ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45092024-08-30T19:49:43.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45102024-08-30T19:49:43.521ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45112024-08-30T19:49:43.522ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45122024-08-30T19:49:43.525ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: aa09ea70-5935-4726-aa8b-daae29285c7a, lookup_type: ById(aa09ea70-5935-4726-aa8b-daae29285c7a) }, key: 0ba5e404-8695-42aa-a849-7665ae57f2aa, lookup_type: ById(0ba5e404-8695-42aa-a849-7665ae57f2aa) }, key: 177df596-2bc8-436c-a193-ec68f297307f, lookup_type: ById(177df596-2bc8-436c-a193-ec68f297307f) } result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45132024-08-30T19:49:43.525ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45142024-08-30T19:49:43.525ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45152024-08-30T19:49:43.536ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: abc56fb8-ba04-4cc7-859c-561136aa9b40, time_created: 2024-08-30T19:49:23.226374Z, time_deleted: None, instance_id: 177df596-2bc8-436c-a193-ec68f297307f, sled_id: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-08-30T19:49:43.366545Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-08-30T19:49:23.303906Z, gen: Generation(Generation(3)), propolis_id: Some(abc56fb8-ba04-4cc7-859c-561136aa9b40), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(abc56fb8-ba04-4cc7-859c-561136aa9b40 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-08-30T19:49:43.533525620Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
45162024-08-30T19:49:43.536ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45172024-08-30T19:49:43.536ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"177df596-2bc8-436c-a193-ec68f297307f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"abc56fb8-ba04-4cc7-859c-561136aa9b40"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"177df596-2bc8-436c-a193-ec68f297307f","lookup_type":{"ById":"177df596-2bc8-436c-a193-ec68f297307f"},"parent":{"key":"0ba5e404-8695-42aa-a849-7665ae57f2aa","lookup_type":{"ById":"0ba5e404-8695-42aa-a849-7665ae57f2aa"},"parent":{"key":"aa09ea70-5935-4726-aa8b-daae29285c7a","lookup_type":{"ById":"aa09ea70-5935-4726-aa8b-daae29285c7a"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"e198f43d-4e2e-4bcc-8b3c-f82171317613"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"0ba5e404-8695-42aa-a849-7665ae57f2aa","ram_diff":1073741824},"destroy_active_vmm":"abc56fb8-ba04-4cc7-859c-561136aa9b40","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-08-30T19:49:43.533525620Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45182024-08-30T19:49:43.536ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45192024-08-30T19:49:43.542ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45202024-08-30T19:49:43.542ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45212024-08-30T19:49:43.542ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45222024-08-30T19:49:43.542ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45232024-08-30T19:49:43.548ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45242024-08-30T19:49:43.548ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45252024-08-30T19:49:43.554ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45262024-08-30T19:49:43.554ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45272024-08-30T19:49:43.558ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45282024-08-30T19:49:43.558ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("da5b5980-01cb-4207-adc5-f4bc629e7c13")) node_id = 0 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45292024-08-30T19:49:43.564ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45302024-08-30T19:49:43.564ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45312024-08-30T19:49:43.567ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 177df596-2bc8-436c-a193-ec68f297307f parent_lock = UpdaterLock { updater_id: e198f43d-4e2e-4bcc-8b3c-f82171317613, locked_gen: Generation(Generation(2)) } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45322024-08-30T19:49:43.567ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = BecomeUpdater
45332024-08-30T19:49:43.567ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = BecomeUpdater
45342024-08-30T19:49:43.578ZDEBGnexus (SagaExecutor): inherited lock from e198f43d-4e2e-4bcc-8b3c-f82171317613 to da5b5980-01cb-4207-adc5-f4bc629e7c13 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 177df596-2bc8-436c-a193-ec68f297307f locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = e198f43d-4e2e-4bcc-8b3c-f82171317613 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = BecomeUpdater updater_id = da5b5980-01cb-4207-adc5-f4bc629e7c13
45352024-08-30T19:49:43.580ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:932 instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45362024-08-30T19:49:43.580ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45372024-08-30T19:49:43.580ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("da5b5980-01cb-4207-adc5-f4bc629e7c13")}) node_id = 1 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45382024-08-30T19:49:43.586ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45392024-08-30T19:49:43.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45402024-08-30T19:49:43.590ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45412024-08-30T19:49:43.590ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45422024-08-30T19:49:43.595ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45432024-08-30T19:49:43.595ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45442024-08-30T19:49:43.599ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:985 instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45452024-08-30T19:49:43.604ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 177df596-2bc8-436c-a193-ec68f297307f
45462024-08-30T19:49:43.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UpdateNetworkConfig
45472024-08-30T19:49:43.607ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UpdateNetworkConfig
45482024-08-30T19:49:43.609ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UpdateNetworkConfig
45492024-08-30T19:49:43.609ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UpdateNetworkConfig
45502024-08-30T19:49:43.614ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
45512024-08-30T19:49:43.614ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UpdateNetworkConfig
45522024-08-30T19:49:43.614ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UpdateNetworkConfig
45532024-08-30T19:49:43.616ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
45542024-08-30T19:49:43.616ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
45552024-08-30T19:49:43.616ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
45562024-08-30T19:49:43.617ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
45572024-08-30T19:49:43.618ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
45582024-08-30T19:49:43.618ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
45592024-08-30T19:49:43.618ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
45602024-08-30T19:49:43.622ZDEBGnexus: notifying dendrite of updates instance_id = Some(177df596-2bc8-436c-a193-ec68f297307f (instance)) switch = switch0
45612024-08-30T19:49:43.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1269, tv_nsec: 927502544 } })
45622024-08-30T19:49:43.623ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
45632024-08-30T19:49:43.654ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45642024-08-30T19:49:43.654ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45652024-08-30T19:49:43.654ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "383b3fe7-eb86-41b3-8778-b88f75dbb674", "content-length": "26", "date": "Fri, 30 Aug 2024 19:49:43 GMT"} })
45662024-08-30T19:49:43.654ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45672024-08-30T19:49:43.655ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45682024-08-30T19:49:43.684ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
45692024-08-30T19:49:43.684ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c8c20ff-e2c0-4e15-b5a0-788daedbc256", "content-length": "4", "date": "Fri, 30 Aug 2024 19:49:43 GMT"} })
45702024-08-30T19:49:43.686ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45712024-08-30T19:49:43.686ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45722024-08-30T19:49:43.689ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45732024-08-30T19:49:43.689ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45742024-08-30T19:49:43.693ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
45752024-08-30T19:49:43.693ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
45762024-08-30T19:49:43.719ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1060 instance_id = 177df596-2bc8-436c-a193-ec68f297307f records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-08-30T19:49:43.704866Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 0ba5e404-8695-42aa-a849-7665ae57f2aa, time_modified: Some(2024-08-30T19:49:43.704866Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: aa09ea70-5935-4726-aa8b-daae29285c7a, time_modified: Some(2024-08-30T19:49:43.704866Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45772024-08-30T19:49:43.719ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45782024-08-30T19:49:43.719ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45792024-08-30T19:49:43.725ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45802024-08-30T19:49:43.725ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45812024-08-30T19:49:43.729ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1095 instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45822024-08-30T19:49:43.729ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UnassignOximeterProducer
45832024-08-30T19:49:43.729ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UnassignOximeterProducer
45842024-08-30T19:49:43.736ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c producer_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45852024-08-30T19:49:43.736ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UnassignOximeterProducer
45862024-08-30T19:49:43.736ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = UnassignOximeterProducer
45872024-08-30T19:49:43.772ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45882024-08-30T19:49:43.772ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 177df596-2bc8-436c-a193-ec68f297307f saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/177df596-2bc8-436c-a193-ec68f297307f
45892024-08-30T19:49:43.773ZDEBGnexus (SagaExecutor): client response oximeter-collector = 177df596-2bc8-436c-a193-ec68f297307f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/177df596-2bc8-436c-a193-ec68f297307f", query: None, fragment: None }, status: 204, headers: {"x-request-id": "34f91c7d-7b1a-41e1-b640-4399c14297ff", "date": "Fri, 30 Aug 2024 19:49:43 GMT"} }) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45902024-08-30T19:49:43.773ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c producer_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45912024-08-30T19:49:43.774ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45922024-08-30T19:49:43.774ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45932024-08-30T19:49:43.780ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
45942024-08-30T19:49:43.780ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
45952024-08-30T19:49:43.788ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 177df596-2bc8-436c-a193-ec68f297307f lock = UpdaterLock { updater_id: da5b5980-01cb-4207-adc5-f4bc629e7c13, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-08-30T19:49:43.533525620Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45962024-08-30T19:49:43.788ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
45972024-08-30T19:49:43.788ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
45982024-08-30T19:49:43.824ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1144 instance_id = 177df596-2bc8-436c-a193-ec68f297307f new_runtime = InstanceRuntimeState { time_updated: 2024-08-30T19:49:43.533525620Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
45992024-08-30T19:49:43.824ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46002024-08-30T19:49:43.824ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
46012024-08-30T19:49:43.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46022024-08-30T19:49:43.825ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46032024-08-30T19:49:43.825ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
46042024-08-30T19:49:43.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46052024-08-30T19:49:43.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46062024-08-30T19:49:43.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46072024-08-30T19:49:43.826ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46082024-08-30T19:49:43.826ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46092024-08-30T19:49:43.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46102024-08-30T19:49:43.827ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46112024-08-30T19:49:43.827ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46122024-08-30T19:49:43.828ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46132024-08-30T19:49:43.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46142024-08-30T19:49:43.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46152024-08-30T19:49:43.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46162024-08-30T19:49:43.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46172024-08-30T19:49:43.831ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: aa09ea70-5935-4726-aa8b-daae29285c7a, lookup_type: ById(aa09ea70-5935-4726-aa8b-daae29285c7a) }, key: 0ba5e404-8695-42aa-a849-7665ae57f2aa, lookup_type: ById(0ba5e404-8695-42aa-a849-7665ae57f2aa) }, key: 177df596-2bc8-436c-a193-ec68f297307f, lookup_type: ById(177df596-2bc8-436c-a193-ec68f297307f) } result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46182024-08-30T19:49:43.831ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46192024-08-30T19:49:43.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = CommitInstanceUpdates
46202024-08-30T19:49:43.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46212024-08-30T19:49:43.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46222024-08-30T19:49:43.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46232024-08-30T19:49:43.836ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46242024-08-30T19:49:43.836ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46252024-08-30T19:49:43.841ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46262024-08-30T19:49:43.841ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46272024-08-30T19:49:43.846ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46282024-08-30T19:49:43.846ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("177df596-2bc8-436c-a193-ec68f297307f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("abc56fb8-ba04-4cc7-859c-561136aa9b40")}) node_id = 7 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46292024-08-30T19:49:43.856ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46302024-08-30T19:49:43.856ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46312024-08-30T19:49:43.864ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46322024-08-30T19:49:43.864ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46332024-08-30T19:49:43.864ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46342024-08-30T19:49:43.865ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8dfb5d0b-c9a3-4ae2-9a90-26e6bc922c0b", "content-length": "372", "date": "Fri, 30 Aug 2024 19:49:43 GMT"} })
46352024-08-30T19:49:43.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46362024-08-30T19:49:43.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46372024-08-30T19:49:43.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46382024-08-30T19:49:43.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46392024-08-30T19:49:43.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46402024-08-30T19:49:43.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46412024-08-30T19:49:43.871ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46422024-08-30T19:49:43.871ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46432024-08-30T19:49:43.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46442024-08-30T19:49:43.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e27cfea6-5ff6-4223-b759-6664740d6939", "date": "Fri, 30 Aug 2024 19:49:43 GMT"} })
46452024-08-30T19:49:43.874ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 49.227204ms iteration = 16 status = {}
46462024-08-30T19:49:43.877ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 177df596-2bc8-436c-a193-ec68f297307f propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
46472024-08-30T19:49:43.877ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = ReleaseSledResources
46482024-08-30T19:49:43.877ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = ReleaseSledResources
46492024-08-30T19:49:43.884ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46502024-08-30T19:49:43.884ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46512024-08-30T19:49:43.890ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46522024-08-30T19:49:43.890ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46532024-08-30T19:49:43.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = d3993b8f-a3f7-4c9b-85e6-9e6d12e1cb17 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
46542024-08-30T19:49:43.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = d3993b8f-a3f7-4c9b-85e6-9e6d12e1cb17 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
46552024-08-30T19:49:43.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = d3993b8f-a3f7-4c9b-85e6-9e6d12e1cb17 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
46562024-08-30T19:49:43.896ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 177df596-2bc8-436c-a193-ec68f297307f propolis_id = abc56fb8-ba04-4cc7-859c-561136aa9b40 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update
46572024-08-30T19:49:43.896ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = MarkVmmDeleted
46582024-08-30T19:49:43.896ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_node = MarkVmmDeleted
46592024-08-30T19:49:43.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46602024-08-30T19:49:43.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46612024-08-30T19:49:43.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46622024-08-30T19:49:43.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46632024-08-30T19:49:43.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46642024-08-30T19:49:43.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46652024-08-30T19:49:43.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46662024-08-30T19:49:43.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46672024-08-30T19:49:43.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46682024-08-30T19:49:43.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46692024-08-30T19:49:43.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46702024-08-30T19:49:43.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46712024-08-30T19:49:43.946ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46722024-08-30T19:49:43.946ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46732024-08-30T19:49:43.969ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46742024-08-30T19:49:43.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d151324-0031-45d8-9abe-b85358195e70", "content-length": "691", "date": "Fri, 30 Aug 2024 19:49:43 GMT"} })
46752024-08-30T19:49:43.969ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46762024-08-30T19:49:43.969ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46772024-08-30T19:49:43.969ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46782024-08-30T19:49:43.972ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 147.384907ms iteration = 15 status = {}
46792024-08-30T19:49:43.975ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46802024-08-30T19:49:43.975ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46812024-08-30T19:49:43.978ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46822024-08-30T19:49:43.978ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46832024-08-30T19:49:43.982ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46842024-08-30T19:49:43.982ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46852024-08-30T19:49:43.987ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46862024-08-30T19:49:43.987ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46872024-08-30T19:49:43.990ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46882024-08-30T19:49:43.990ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806
46892024-08-30T19:49:44.024ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46902024-08-30T19:49:44.024ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 saga_name = instance-update saga_result = SagaResult { saga_id: 1892a20f-4f36-4232-aa18-e67eda5e4806, saga_log: SagaLog { saga_id: 1892a20f-4f36-4232-aa18-e67eda5e4806, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("da5b5980-01cb-4207-adc5-f4bc629e7c13")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("da5b5980-01cb-4207-adc5-f4bc629e7c13")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("177df596-2bc8-436c-a193-ec68f297307f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("abc56fb8-ba04-4cc7-859c-561136aa9b40")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("177df596-2bc8-436c-a193-ec68f297307f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("abc56fb8-ba04-4cc7-859c-561136aa9b40")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("da5b5980-01cb-4207-adc5-f4bc629e7c13"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("da5b5980-01cb-4207-adc5-f4bc629e7c13")}} }) }
46912024-08-30T19:49:44.024ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 1892a20f-4f36-4232-aa18-e67eda5e4806 instance_id = 177df596-2bc8-436c-a193-ec68f297307f saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update
46922024-08-30T19:49:44.025ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46932024-08-30T19:49:44.025ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
46942024-08-30T19:49:44.029ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46952024-08-30T19:49:44.029ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
46962024-08-30T19:49:44.033ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46972024-08-30T19:49:44.033ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
46982024-08-30T19:49:44.037ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
46992024-08-30T19:49:44.037ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d7b04880-58d5-478c-a3e9-21f750c41121
47002024-08-30T19:49:44.075ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update sec_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
47012024-08-30T19:49:44.075ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = d7b04880-58d5-478c-a3e9-21f750c41121 saga_name = start-instance-update saga_result = SagaResult { saga_id: d7b04880-58d5-478c-a3e9-21f750c41121, saga_log: SagaLog { saga_id: d7b04880-58d5-478c-a3e9-21f750c41121, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("e198f43d-4e2e-4bcc-8b3c-f82171317613")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e198f43d-4e2e-4bcc-8b3c-f82171317613")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("e198f43d-4e2e-4bcc-8b3c-f82171317613"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("e198f43d-4e2e-4bcc-8b3c-f82171317613")}} }) }
47022024-08-30T19:49:44.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 16273271-e841-4024-8fed-d9c9b5ef3018 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47032024-08-30T19:49:44.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 16273271-e841-4024-8fed-d9c9b5ef3018 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47042024-08-30T19:49:44.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 16273271-e841-4024-8fed-d9c9b5ef3018 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47052024-08-30T19:49:44.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 2d0d4b3a-613b-47af-bbe2-9a9a0f974f19 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
47062024-08-30T19:49:44.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 2d0d4b3a-613b-47af-bbe2-9a9a0f974f19 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
47072024-08-30T19:49:44.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 2d0d4b3a-613b-47af-bbe2-9a9a0f974f19 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
47082024-08-30T19:49:45.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c4c351d-0a54-46ec-9792-0db90ab92521 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47092024-08-30T19:49:45.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c4c351d-0a54-46ec-9792-0db90ab92521 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47102024-08-30T19:49:45.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7c4c351d-0a54-46ec-9792-0db90ab92521 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47112024-08-30T19:49:46.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b287c533-9944-43d4-b8f4-61190685fdc8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47122024-08-30T19:49:46.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b287c533-9944-43d4-b8f4-61190685fdc8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47132024-08-30T19:49:46.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b287c533-9944-43d4-b8f4-61190685fdc8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47142024-08-30T19:49:47.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75c73a21-e662-4176-a787-1e4354317548 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47152024-08-30T19:49:47.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75c73a21-e662-4176-a787-1e4354317548 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47162024-08-30T19:49:47.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 75c73a21-e662-4176-a787-1e4354317548 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47172024-08-30T19:49:48.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 937df1ba-ef10-44e2-916e-38dc25655e13 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47182024-08-30T19:49:48.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 937df1ba-ef10-44e2-916e-38dc25655e13 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47192024-08-30T19:49:48.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 937df1ba-ef10-44e2-916e-38dc25655e13 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47202024-08-30T19:49:49.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 48f303ad-3959-4ff2-9ac6-d86bc1c5da30 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47212024-08-30T19:49:49.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 48f303ad-3959-4ff2-9ac6-d86bc1c5da30 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47222024-08-30T19:49:49.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 48f303ad-3959-4ff2-9ac6-d86bc1c5da30 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47232024-08-30T19:49:50.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 4374b465-6acb-472b-b64b-3afb387bd950 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
47242024-08-30T19:49:50.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f4e9ec54-7471-497d-8620-a0d21a518103 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47252024-08-30T19:49:50.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f4e9ec54-7471-497d-8620-a0d21a518103 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47262024-08-30T19:49:50.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f4e9ec54-7471-497d-8620-a0d21a518103 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47272024-08-30T19:49:51.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c9f8cae2-3a3a-4d33-af0c-98de10b4318c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47282024-08-30T19:49:51.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c9f8cae2-3a3a-4d33-af0c-98de10b4318c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47292024-08-30T19:49:51.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c9f8cae2-3a3a-4d33-af0c-98de10b4318c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47302024-08-30T19:49:51.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
47312024-08-30T19:49:51.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
47322024-08-30T19:49:51.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47332024-08-30T19:49:51.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47342024-08-30T19:49:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47352024-08-30T19:49:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47362024-08-30T19:49:51.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47372024-08-30T19:49:51.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47382024-08-30T19:49:51.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47392024-08-30T19:49:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47402024-08-30T19:49:51.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47412024-08-30T19:49:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47422024-08-30T19:49:51.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47432024-08-30T19:49:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47442024-08-30T19:49:51.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47452024-08-30T19:49:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
47462024-08-30T19:49:51.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47472024-08-30T19:49:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47482024-08-30T19:49:51.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
47492024-08-30T19:49:51.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.967478ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
47502024-08-30T19:49:51.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.996231ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47512024-08-30T19:49:52.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b736b50e-e72d-4056-ad7a-157f54470fd5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47522024-08-30T19:49:52.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b736b50e-e72d-4056-ad7a-157f54470fd5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47532024-08-30T19:49:52.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b736b50e-e72d-4056-ad7a-157f54470fd5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47542024-08-30T19:49:53.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1c5ee4fe-ec6d-484e-9e7f-9c73cc9bbcf5 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47552024-08-30T19:49:53.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1c5ee4fe-ec6d-484e-9e7f-9c73cc9bbcf5 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47562024-08-30T19:49:53.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1c5ee4fe-ec6d-484e-9e7f-9c73cc9bbcf5 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47572024-08-30T19:49:54.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bef66db9-3c2f-4d0d-8bc7-76817cc07f60 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47582024-08-30T19:49:54.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bef66db9-3c2f-4d0d-8bc7-76817cc07f60 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47592024-08-30T19:49:54.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bef66db9-3c2f-4d0d-8bc7-76817cc07f60 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47602024-08-30T19:49:55.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d43913cf-830e-43b9-bac4-a3b85f41134f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47612024-08-30T19:49:55.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d43913cf-830e-43b9-bac4-a3b85f41134f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47622024-08-30T19:49:55.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d43913cf-830e-43b9-bac4-a3b85f41134f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47632024-08-30T19:49:56.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0b07cf11-af64-4f77-99a7-9083dd310ba1 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47642024-08-30T19:49:56.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0b07cf11-af64-4f77-99a7-9083dd310ba1 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47652024-08-30T19:49:56.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0b07cf11-af64-4f77-99a7-9083dd310ba1 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47662024-08-30T19:49:57.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f9d5cf18-0fc6-44c7-93c4-ff1d4878f410 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47672024-08-30T19:49:57.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f9d5cf18-0fc6-44c7-93c4-ff1d4878f410 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47682024-08-30T19:49:57.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f9d5cf18-0fc6-44c7-93c4-ff1d4878f410 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47692024-08-30T19:49:58.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1d13c2e8-ccca-4f74-a10d-4a50e4fcdc9f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47702024-08-30T19:49:58.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1d13c2e8-ccca-4f74-a10d-4a50e4fcdc9f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47712024-08-30T19:49:58.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1d13c2e8-ccca-4f74-a10d-4a50e4fcdc9f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47722024-08-30T19:49:59.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 97717272-2fea-4c15-b119-423d461733ad roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47732024-08-30T19:49:59.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 97717272-2fea-4c15-b119-423d461733ad resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47742024-08-30T19:49:59.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 97717272-2fea-4c15-b119-423d461733ad response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47752024-08-30T19:50:00.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1534 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 7c986917-5257-413b-844f-7db221fa5bab response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
47762024-08-30T19:50:00.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e16ba801-d8a8-4130-b9d4-896878a85191 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47772024-08-30T19:50:00.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e16ba801-d8a8-4130-b9d4-896878a85191 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47782024-08-30T19:50:00.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e16ba801-d8a8-4130-b9d4-896878a85191 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47792024-08-30T19:50:01.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 02a23705-c3b6-4e5d-9b11-0307d485b196 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47802024-08-30T19:50:01.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 02a23705-c3b6-4e5d-9b11-0307d485b196 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47812024-08-30T19:50:01.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 02a23705-c3b6-4e5d-9b11-0307d485b196 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
47822024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
47832024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
47842024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
47852024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47862024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47872024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
47882024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
47892024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47902024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
47912024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47922024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47932024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
47942024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
47952024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
47962024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
47972024-08-30T19:50:01.772ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-30 19:40:01.772617804 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47982024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47992024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
48002024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48012024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48022024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
48032024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
48042024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
48052024-08-30T19:50:01.772ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
48062024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48072024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
48082024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48092024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48102024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48112024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
48122024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
48132024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48142024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48152024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
48162024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48172024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48182024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
48192024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48202024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
48212024-08-30T19:50:01.772ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
48222024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48232024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
48242024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48252024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
48262024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
48272024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48282024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48292024-08-30T19:50:01.772ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
48302024-08-30T19:50:01.772ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25
48312024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
48322024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.92\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25"}
48332024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
48342024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48352024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
48362024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48372024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48382024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48392024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
48402024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
48412024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48422024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48432024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48442024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48452024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48462024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48472024-08-30T19:50:01.773ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5636b10-76ec-4aa4-8bd4-1f95780813df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1288, tv_nsec: 77763437 } })
48482024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48492024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48502024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48512024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48522024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48532024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48542024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48552024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48562024-08-30T19:50:01.773ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8b642bba-10a6-428b-9af7-48d5f8622e03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5d7b957-0082-4dc3-b742-d6e7150a43c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1288, tv_nsec: 77967740 } })
48572024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48582024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48592024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48602024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48612024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48622024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48632024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48642024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48652024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48662024-08-30T19:50:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48672024-08-30T19:50:01.777ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
48682024-08-30T19:50:01.777ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.97555ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
48692024-08-30T19:50:01.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48702024-08-30T19:50:01.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48712024-08-30T19:50:01.778ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
48722024-08-30T19:50:01.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.308631ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
48732024-08-30T19:50:01.778ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.27075ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48742024-08-30T19:50:01.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48752024-08-30T19:50:01.780ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-30 19:40:01.772617804 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48762024-08-30T19:50:01.780ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.770096ms iteration = 8 status = {"expiration":"2024-08-30T19:40:01.772617804Z","pruned":[]}
48772024-08-30T19:50:01.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48782024-08-30T19:50:01.781ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48792024-08-30T19:50:01.781ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1288, tv_nsec: 85821188 } })
48802024-08-30T19:50:01.781ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1288, tv_nsec: 85965010 } })
48812024-08-30T19:50:01.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48822024-08-30T19:50:01.781ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
48832024-08-30T19:50:01.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48842024-08-30T19:50:01.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48852024-08-30T19:50:01.782ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
48862024-08-30T19:50:01.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48872024-08-30T19:50:01.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882024-08-30T19:50:01.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48892024-08-30T19:50:01.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48902024-08-30T19:50:01.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48912024-08-30T19:50:01.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48922024-08-30T19:50:01.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48932024-08-30T19:50:01.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48942024-08-30T19:50:01.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48952024-08-30T19:50:01.788ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.239487ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
48962024-08-30T19:50:01.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48972024-08-30T19:50:01.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48982024-08-30T19:50:01.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48992024-08-30T19:50:01.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49002024-08-30T19:50:01.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49012024-08-30T19:50:01.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49022024-08-30T19:50:01.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49032024-08-30T19:50:01.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49042024-08-30T19:50:01.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49052024-08-30T19:50:01.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49062024-08-30T19:50:01.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49072024-08-30T19:50:01.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49082024-08-30T19:50:01.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49092024-08-30T19:50:01.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49102024-08-30T19:50:01.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1288, tv_nsec: 106330278 } })
49112024-08-30T19:50:01.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
49122024-08-30T19:50:01.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49132024-08-30T19:50:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49142024-08-30T19:50:01.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49152024-08-30T19:50:01.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49162024-08-30T19:50:01.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49172024-08-30T19:50:01.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49182024-08-30T19:50:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49192024-08-30T19:50:01.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49202024-08-30T19:50:01.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49212024-08-30T19:50:01.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49222024-08-30T19:50:01.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49232024-08-30T19:50:01.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49242024-08-30T19:50:01.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
49252024-08-30T19:50:01.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49262024-08-30T19:50:01.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49272024-08-30T19:50:01.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49282024-08-30T19:50:01.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49292024-08-30T19:50:01.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.685407ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
49302024-08-30T19:50:01.829ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49312024-08-30T19:50:01.829ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49322024-08-30T19:50:01.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49332024-08-30T19:50:01.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49342024-08-30T19:50:01.837ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49352024-08-30T19:50:01.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.547003ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
49362024-08-30T19:50:01.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
49372024-08-30T19:50:01.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.768686ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
49382024-08-30T19:50:01.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49392024-08-30T19:50:01.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49402024-08-30T19:50:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49412024-08-30T19:50:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49422024-08-30T19:50:01.840ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49432024-08-30T19:50:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49442024-08-30T19:50:01.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49452024-08-30T19:50:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49462024-08-30T19:50:01.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49472024-08-30T19:50:01.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49482024-08-30T19:50:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49492024-08-30T19:50:01.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49502024-08-30T19:50:01.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49512024-08-30T19:50:01.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.57933ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49522024-08-30T19:50:01.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49532024-08-30T19:50:01.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49542024-08-30T19:50:01.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49552024-08-30T19:50:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49562024-08-30T19:50:01.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49572024-08-30T19:50:01.848ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
49582024-08-30T19:50:01.848ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
49592024-08-30T19:50:01.848ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.905242ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
49602024-08-30T19:50:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49612024-08-30T19:50:01.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49622024-08-30T19:50:01.851ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49632024-08-30T19:50:01.851ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49642024-08-30T19:50:01.851ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49652024-08-30T19:50:01.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49662024-08-30T19:50:01.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49672024-08-30T19:50:01.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49682024-08-30T19:50:01.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692024-08-30T19:50:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
49702024-08-30T19:50:01.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49712024-08-30T19:50:01.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49722024-08-30T19:50:01.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49732024-08-30T19:50:01.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49742024-08-30T19:50:01.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49752024-08-30T19:50:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49762024-08-30T19:50:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49772024-08-30T19:50:01.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49782024-08-30T19:50:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49792024-08-30T19:50:01.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49802024-08-30T19:50:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49812024-08-30T19:50:01.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49822024-08-30T19:50:01.860ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.226148ms iteration = 15 status = 0
49832024-08-30T19:50:01.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49842024-08-30T19:50:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49852024-08-30T19:50:01.868ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49862024-08-30T19:50:01.868ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49872024-08-30T19:50:01.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.940754ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
49882024-08-30T19:50:01.880ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
49892024-08-30T19:50:01.880ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
49902024-08-30T19:50:01.880ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
49912024-08-30T19:50:01.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49922024-08-30T19:50:01.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49932024-08-30T19:50:01.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.851675ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
49942024-08-30T19:50:01.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.800174ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49952024-08-30T19:50:01.890ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49962024-08-30T19:50:01.890ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49972024-08-30T19:50:01.890ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.538462ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49982024-08-30T19:50:01.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49992024-08-30T19:50:01.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50002024-08-30T19:50:01.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50012024-08-30T19:50:01.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50022024-08-30T19:50:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50032024-08-30T19:50:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50042024-08-30T19:50:01.901ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50052024-08-30T19:50:01.901ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50062024-08-30T19:50:01.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50072024-08-30T19:50:01.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50082024-08-30T19:50:01.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50092024-08-30T19:50:01.918ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50102024-08-30T19:50:01.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50112024-08-30T19:50:01.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50122024-08-30T19:50:01.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50132024-08-30T19:50:01.923ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50142024-08-30T19:50:01.925ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50152024-08-30T19:50:01.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 152.351753ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
50162024-08-30T19:50:01.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50172024-08-30T19:50:01.927ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50182024-08-30T19:50:01.927ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "73eacaf5-0f2e-407c-b29b-e0f83bd981f8", "content-length": "26", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
50192024-08-30T19:50:01.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50202024-08-30T19:50:01.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50212024-08-30T19:50:01.928ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50222024-08-30T19:50:01.928ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9275ecce-c876-4b3d-af3f-a84a959787d3", "content-length": "26", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
50232024-08-30T19:50:01.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50242024-08-30T19:50:01.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50252024-08-30T19:50:01.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50262024-08-30T19:50:01.932ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.387067ms iteration = 18 status = {"physical_disks_added":0}
50272024-08-30T19:50:01.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50282024-08-30T19:50:01.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50292024-08-30T19:50:01.952ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
50302024-08-30T19:50:01.952ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50312024-08-30T19:50:01.953ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a731ac8-32f5-413e-b9b9-1f116f2341c6", "content-length": "26", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
50322024-08-30T19:50:01.953ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50332024-08-30T19:50:01.954ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
50342024-08-30T19:50:01.997ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50352024-08-30T19:50:01.998ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "da3344d3-9baf-41e0-8380-b128ad0f5f68", "content-length": "372", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
50362024-08-30T19:50:01.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50372024-08-30T19:50:01.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50382024-08-30T19:50:02.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50392024-08-30T19:50:02.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50402024-08-30T19:50:02.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50412024-08-30T19:50:02.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50422024-08-30T19:50:02.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50432024-08-30T19:50:02.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50442024-08-30T19:50:02.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50452024-08-30T19:50:02.012ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
50462024-08-30T19:50:02.012ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
50472024-08-30T19:50:02.012ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-30 19:43:16.884603 UTC dns_group = internal generation = 1
50482024-08-30T19:50:02.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 240.273907ms iteration = 9 status = {"generation":1}
50492024-08-30T19:50:02.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50502024-08-30T19:50:02.016ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50512024-08-30T19:50:02.017ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a906efd5-7dc3-4919-86de-4d31f353379a", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
50522024-08-30T19:50:02.020ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.611715ms iteration = 17 status = {}
50532024-08-30T19:50:02.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 270.540407ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50542024-08-30T19:50:02.046ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
50552024-08-30T19:50:02.046ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 0 version = 2
50562024-08-30T19:50:02.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50572024-08-30T19:50:02.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50582024-08-30T19:50:02.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50592024-08-30T19:50:02.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50602024-08-30T19:50:02.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50612024-08-30T19:50:02.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50622024-08-30T19:50:02.050ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-30T19:42:58.455639Z, time_modified: 2024-08-30T19:42:58.455639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
50632024-08-30T19:50:02.050ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 278.251272ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]}},"default_endpoint":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
50642024-08-30T19:50:02.052ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 1 version = 2
50652024-08-30T19:50:02.052ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50662024-08-30T19:50:02.052ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-30 19:43:18.363870 UTC dns_group = external generation = 2
50672024-08-30T19:50:02.052ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 280.235207ms iteration = 9 status = {"generation":2}
50682024-08-30T19:50:02.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50692024-08-30T19:50:02.082ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50702024-08-30T19:50:02.083ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5c13817b-716b-425c-9b73-3b7323ceb71a", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50712024-08-30T19:50:02.083ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50722024-08-30T19:50:02.084ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50732024-08-30T19:50:02.085ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a775ab7-b12a-4bc8-b868-cc65bb58e12d", "content-length": "2", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
50742024-08-30T19:50:02.086ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "04a3518c-b1dd-475c-b7ea-27be24f3c682", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50752024-08-30T19:50:02.086ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50762024-08-30T19:50:02.092ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50772024-08-30T19:50:02.092ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 319.475115ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50782024-08-30T19:50:02.092ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50792024-08-30T19:50:02.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50802024-08-30T19:50:02.092ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 320.083187ms iteration = 15 status = {}
50812024-08-30T19:50:02.093ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 321.45646ms iteration = 15 status = null
50822024-08-30T19:50:02.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50832024-08-30T19:50:02.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50842024-08-30T19:50:02.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50852024-08-30T19:50:02.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50862024-08-30T19:50:02.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50872024-08-30T19:50:02.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50882024-08-30T19:50:02.137ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50892024-08-30T19:50:02.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5527b41e-32a9-4cc3-a524-bc2b2ed6a3ed", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50902024-08-30T19:50:02.138ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50912024-08-30T19:50:02.139ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "062ab2d5-0347-43e9-ba78-44445a201c18", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50922024-08-30T19:50:02.139ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50932024-08-30T19:50:02.141ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "972f3d38-9b74-47fb-b9b3-46d85308d73c", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50942024-08-30T19:50:02.141ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50952024-08-30T19:50:02.142ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50962024-08-30T19:50:02.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 370.211056ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50972024-08-30T19:50:02.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50982024-08-30T19:50:02.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50992024-08-30T19:50:02.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51002024-08-30T19:50:02.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51012024-08-30T19:50:02.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51022024-08-30T19:50:02.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51032024-08-30T19:50:02.188ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
51042024-08-30T19:50:02.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51052024-08-30T19:50:02.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51062024-08-30T19:50:02.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51072024-08-30T19:50:02.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2d0633a-622e-48f2-8224-d9692e41c818", "content-length": "121", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
51082024-08-30T19:50:02.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
51092024-08-30T19:50:02.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
51102024-08-30T19:50:02.204ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51112024-08-30T19:50:02.204ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51122024-08-30T19:50:02.204ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
51132024-08-30T19:50:02.204ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
51142024-08-30T19:50:02.204ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
51152024-08-30T19:50:02.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51162024-08-30T19:50:02.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51172024-08-30T19:50:02.206ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51182024-08-30T19:50:02.206ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fbe74994-0370-4ecc-94dc-cabf068b9dd2", "content-length": "2", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
51192024-08-30T19:50:02.206ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51202024-08-30T19:50:02.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f198bb88-220b-441e-b212-58361b0dfb24", "content-length": "52", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
51212024-08-30T19:50:02.207ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
51222024-08-30T19:50:02.207ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51232024-08-30T19:50:02.239ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51242024-08-30T19:50:02.325ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "61a433ca-062d-4aec-8f3c-a60751f54773", "date": "Fri, 30 Aug 2024 19:50:01 GMT"} })
51252024-08-30T19:50:02.325ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
51262024-08-30T19:50:02.325ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51272024-08-30T19:50:02.330ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "707760c0-0ee2-49fb-916e-09e6daaa46cc", "content-length": "667", "date": "Fri, 30 Aug 2024 19:50:02 GMT"} })
51282024-08-30T19:50:02.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51292024-08-30T19:50:02.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51302024-08-30T19:50:02.330ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f359340-b85d-4353-a835-9aa052d0b1e1", "content-length": "691", "date": "Fri, 30 Aug 2024 19:50:02 GMT"} })
51312024-08-30T19:50:02.330ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51322024-08-30T19:50:02.330ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51332024-08-30T19:50:02.330ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51342024-08-30T19:50:02.331ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 558.815705ms iteration = 16 status = {}
51352024-08-30T19:50:02.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51362024-08-30T19:50:02.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51372024-08-30T19:50:02.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51382024-08-30T19:50:02.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51392024-08-30T19:50:02.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51402024-08-30T19:50:02.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51412024-08-30T19:50:02.344ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 572.112389ms iteration = 15 status = {}
51422024-08-30T19:50:02.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 236879a4-5c03-44cb-946a-4c9f56b9f140 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51432024-08-30T19:50:02.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 236879a4-5c03-44cb-946a-4c9f56b9f140 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51442024-08-30T19:50:02.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 236879a4-5c03-44cb-946a-4c9f56b9f140 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51452024-08-30T19:50:03.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 08b38d89-97d4-415f-99c9-32b3196c40e0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51462024-08-30T19:50:03.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 08b38d89-97d4-415f-99c9-32b3196c40e0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51472024-08-30T19:50:03.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 08b38d89-97d4-415f-99c9-32b3196c40e0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51482024-08-30T19:50:04.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bb0eb72e-a7e0-4f6f-8481-ae1e66efb40d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51492024-08-30T19:50:04.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bb0eb72e-a7e0-4f6f-8481-ae1e66efb40d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51502024-08-30T19:50:04.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bb0eb72e-a7e0-4f6f-8481-ae1e66efb40d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51512024-08-30T19:50:05.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 911094df-3fb7-434e-bdab-c7778317ffe3 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51522024-08-30T19:50:05.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 911094df-3fb7-434e-bdab-c7778317ffe3 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51532024-08-30T19:50:05.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 911094df-3fb7-434e-bdab-c7778317ffe3 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51542024-08-30T19:50:06.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 85a0cbd9-586f-4a39-8176-28220c787313 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51552024-08-30T19:50:06.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 85a0cbd9-586f-4a39-8176-28220c787313 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51562024-08-30T19:50:06.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 85a0cbd9-586f-4a39-8176-28220c787313 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51572024-08-30T19:50:07.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1786ba35-4a4f-461e-84ef-d9bb8c3f1fd9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51582024-08-30T19:50:07.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1786ba35-4a4f-461e-84ef-d9bb8c3f1fd9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51592024-08-30T19:50:07.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1786ba35-4a4f-461e-84ef-d9bb8c3f1fd9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51602024-08-30T19:50:08.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = aaa55beb-6b01-4ed8-bfde-c81054b937d0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51612024-08-30T19:50:08.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = aaa55beb-6b01-4ed8-bfde-c81054b937d0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51622024-08-30T19:50:08.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = aaa55beb-6b01-4ed8-bfde-c81054b937d0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51632024-08-30T19:50:09.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 65b09d39-6fe9-473a-b960-25eb7866107d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51642024-08-30T19:50:09.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 65b09d39-6fe9-473a-b960-25eb7866107d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51652024-08-30T19:50:09.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 65b09d39-6fe9-473a-b960-25eb7866107d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51662024-08-30T19:50:10.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = ae85f4b2-3dad-4c36-a224-04d9eca5f65b response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
51672024-08-30T19:50:10.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 515474a6-50e6-492e-ab78-1ab07b79a408 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51682024-08-30T19:50:10.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 515474a6-50e6-492e-ab78-1ab07b79a408 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51692024-08-30T19:50:10.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 515474a6-50e6-492e-ab78-1ab07b79a408 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51702024-08-30T19:50:11.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = db5495e7-70b3-45ca-9cfe-259440aee436 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51712024-08-30T19:50:11.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = db5495e7-70b3-45ca-9cfe-259440aee436 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51722024-08-30T19:50:11.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = db5495e7-70b3-45ca-9cfe-259440aee436 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51732024-08-30T19:50:11.773ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
51742024-08-30T19:50:11.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
51752024-08-30T19:50:11.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51762024-08-30T19:50:11.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51772024-08-30T19:50:11.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51782024-08-30T19:50:11.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51792024-08-30T19:50:11.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51802024-08-30T19:50:11.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51812024-08-30T19:50:11.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51822024-08-30T19:50:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51832024-08-30T19:50:11.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51842024-08-30T19:50:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51852024-08-30T19:50:11.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51862024-08-30T19:50:11.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51872024-08-30T19:50:11.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.501882ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51882024-08-30T19:50:11.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51892024-08-30T19:50:11.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
51902024-08-30T19:50:11.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51912024-08-30T19:50:11.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51922024-08-30T19:50:11.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
51932024-08-30T19:50:11.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.170919ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
51942024-08-30T19:50:12.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52fccaf3-6152-4ef2-8549-228e5f95cedb roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51952024-08-30T19:50:12.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52fccaf3-6152-4ef2-8549-228e5f95cedb resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51962024-08-30T19:50:12.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52fccaf3-6152-4ef2-8549-228e5f95cedb response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51972024-08-30T19:50:13.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e14a97f1-4645-42cc-b515-6e7a1624d0bb roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51982024-08-30T19:50:13.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e14a97f1-4645-42cc-b515-6e7a1624d0bb resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
51992024-08-30T19:50:13.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e14a97f1-4645-42cc-b515-6e7a1624d0bb response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52002024-08-30T19:50:14.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bab8aa6b-4e4c-4f7a-90ce-ab0e8670259d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52012024-08-30T19:50:14.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bab8aa6b-4e4c-4f7a-90ce-ab0e8670259d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52022024-08-30T19:50:14.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bab8aa6b-4e4c-4f7a-90ce-ab0e8670259d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52032024-08-30T19:50:14.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 434ab8d0-698d-4bce-aab0-0b797080bd9c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
52042024-08-30T19:50:14.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 434ab8d0-698d-4bce-aab0-0b797080bd9c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
52052024-08-30T19:50:14.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 434ab8d0-698d-4bce-aab0-0b797080bd9c response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
52062024-08-30T19:50:15.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4186a950-b169-4aa3-86c8-e9d6949fbd85 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52072024-08-30T19:50:15.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4186a950-b169-4aa3-86c8-e9d6949fbd85 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52082024-08-30T19:50:15.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4186a950-b169-4aa3-86c8-e9d6949fbd85 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52092024-08-30T19:50:16.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6ad357eb-20b4-48e1-86ec-3f5212fad2f2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52102024-08-30T19:50:16.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6ad357eb-20b4-48e1-86ec-3f5212fad2f2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52112024-08-30T19:50:16.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6ad357eb-20b4-48e1-86ec-3f5212fad2f2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52122024-08-30T19:50:17.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23611b34-983e-4aeb-a317-a748b23a6c7a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52132024-08-30T19:50:17.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23611b34-983e-4aeb-a317-a748b23a6c7a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52142024-08-30T19:50:17.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23611b34-983e-4aeb-a317-a748b23a6c7a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52152024-08-30T19:50:18.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 51bb6632-0a28-4fb4-86a2-70b6764808b1 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52162024-08-30T19:50:18.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 51bb6632-0a28-4fb4-86a2-70b6764808b1 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52172024-08-30T19:50:18.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 51bb6632-0a28-4fb4-86a2-70b6764808b1 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52182024-08-30T19:50:19.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 78c5e64d-022c-48eb-bcc8-f29f795f225b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52192024-08-30T19:50:19.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 78c5e64d-022c-48eb-bcc8-f29f795f225b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52202024-08-30T19:50:19.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 78c5e64d-022c-48eb-bcc8-f29f795f225b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52212024-08-30T19:50:20.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = deaf198f-d2ff-4bf6-9dfb-4db7782d9a6e response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
52222024-08-30T19:50:20.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4b0d2756-8629-430a-bd48-b7cc815e2c6d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52232024-08-30T19:50:20.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4b0d2756-8629-430a-bd48-b7cc815e2c6d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52242024-08-30T19:50:20.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4b0d2756-8629-430a-bd48-b7cc815e2c6d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52252024-08-30T19:50:21.773ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
52262024-08-30T19:50:21.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
52272024-08-30T19:50:21.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52282024-08-30T19:50:21.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52292024-08-30T19:50:21.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52302024-08-30T19:50:21.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52312024-08-30T19:50:21.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52322024-08-30T19:50:21.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52332024-08-30T19:50:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52342024-08-30T19:50:21.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52352024-08-30T19:50:21.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52362024-08-30T19:50:21.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52372024-08-30T19:50:21.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52382024-08-30T19:50:21.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52392024-08-30T19:50:21.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52402024-08-30T19:50:21.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
52412024-08-30T19:50:21.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52422024-08-30T19:50:21.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52432024-08-30T19:50:21.795ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
52442024-08-30T19:50:21.795ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.402613ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
52452024-08-30T19:50:21.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.105034ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52462024-08-30T19:50:21.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b1a92cf4-5cc1-446a-bcb8-705fdde379a2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52472024-08-30T19:50:21.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b1a92cf4-5cc1-446a-bcb8-705fdde379a2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52482024-08-30T19:50:21.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b1a92cf4-5cc1-446a-bcb8-705fdde379a2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52492024-08-30T19:50:23.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 15e25f25-d182-4a8e-bf79-e955c8c92178 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52502024-08-30T19:50:23.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 15e25f25-d182-4a8e-bf79-e955c8c92178 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52512024-08-30T19:50:23.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 15e25f25-d182-4a8e-bf79-e955c8c92178 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52522024-08-30T19:50:24.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dc39db3e-7312-4178-b1e6-0d6d7b758318 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52532024-08-30T19:50:24.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dc39db3e-7312-4178-b1e6-0d6d7b758318 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52542024-08-30T19:50:24.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = dc39db3e-7312-4178-b1e6-0d6d7b758318 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52552024-08-30T19:50:25.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3c0b584f-e63e-4905-ad19-c89eb6a1b15e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52562024-08-30T19:50:25.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3c0b584f-e63e-4905-ad19-c89eb6a1b15e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52572024-08-30T19:50:25.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3c0b584f-e63e-4905-ad19-c89eb6a1b15e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52582024-08-30T19:50:26.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c78d8392-2113-4dc1-8fac-8ab3b7d7995a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52592024-08-30T19:50:26.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c78d8392-2113-4dc1-8fac-8ab3b7d7995a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52602024-08-30T19:50:26.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c78d8392-2113-4dc1-8fac-8ab3b7d7995a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52612024-08-30T19:50:27.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 009f5533-dd2d-4136-a60e-0234e4894227 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52622024-08-30T19:50:27.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 009f5533-dd2d-4136-a60e-0234e4894227 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52632024-08-30T19:50:27.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 009f5533-dd2d-4136-a60e-0234e4894227 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52642024-08-30T19:50:28.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a05fa721-08f9-4809-a9a5-4fe4b6183c41 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52652024-08-30T19:50:28.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a05fa721-08f9-4809-a9a5-4fe4b6183c41 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52662024-08-30T19:50:28.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a05fa721-08f9-4809-a9a5-4fe4b6183c41 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52672024-08-30T19:50:29.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c55aded-86b1-4acd-b00a-2d74d9b147aa roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52682024-08-30T19:50:29.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c55aded-86b1-4acd-b00a-2d74d9b147aa resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52692024-08-30T19:50:29.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c55aded-86b1-4acd-b00a-2d74d9b147aa response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52702024-08-30T19:50:30.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 712a0302-ebf2-4f4f-ad00-b5c3289b7d87 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52712024-08-30T19:50:30.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 712a0302-ebf2-4f4f-ad00-b5c3289b7d87 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52722024-08-30T19:50:30.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 712a0302-ebf2-4f4f-ad00-b5c3289b7d87 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52732024-08-30T19:50:30.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1372 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 1eb95227-d31e-4f49-9816-0eb3c4455e74 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
52742024-08-30T19:50:31.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 49ca1fae-da4a-4e3e-8f78-94e48d90aaa0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52752024-08-30T19:50:31.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 49ca1fae-da4a-4e3e-8f78-94e48d90aaa0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52762024-08-30T19:50:31.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 49ca1fae-da4a-4e3e-8f78-94e48d90aaa0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
52772024-08-30T19:50:31.772ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
52782024-08-30T19:50:31.772ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
52792024-08-30T19:50:31.772ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
52802024-08-30T19:50:31.772ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52812024-08-30T19:50:31.772ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52822024-08-30T19:50:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52832024-08-30T19:50:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52842024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
52852024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
52862024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52872024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52882024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
52892024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
52902024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52912024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52922024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
52932024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
52942024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52952024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52962024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
52972024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
52982024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52992024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53002024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
53012024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53022024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
53032024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53042024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
53052024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53062024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
53072024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53082024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53092024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
53102024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53112024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
53122024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53132024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53142024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53152024-08-30T19:50:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53162024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53172024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53192024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53202024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53212024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53222024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53232024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53242024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53252024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53262024-08-30T19:50:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53272024-08-30T19:50:31.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53282024-08-30T19:50:31.776ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.782036ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53292024-08-30T19:50:31.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53302024-08-30T19:50:31.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53312024-08-30T19:50:31.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 81581444 } })
53322024-08-30T19:50:31.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 81771477 } })
53332024-08-30T19:50:31.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
53342024-08-30T19:50:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53352024-08-30T19:50:31.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53362024-08-30T19:50:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53372024-08-30T19:50:31.779ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
53382024-08-30T19:50:31.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53392024-08-30T19:50:31.779ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53402024-08-30T19:50:31.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53412024-08-30T19:50:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53422024-08-30T19:50:31.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53432024-08-30T19:50:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53442024-08-30T19:50:31.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53452024-08-30T19:50:31.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53462024-08-30T19:50:31.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53472024-08-30T19:50:31.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53482024-08-30T19:50:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53492024-08-30T19:50:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53502024-08-30T19:50:31.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53512024-08-30T19:50:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53522024-08-30T19:50:31.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53532024-08-30T19:50:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53542024-08-30T19:50:31.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53552024-08-30T19:50:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53562024-08-30T19:50:31.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53572024-08-30T19:50:31.790ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 95010950 } })
53582024-08-30T19:50:31.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53592024-08-30T19:50:31.791ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
53602024-08-30T19:50:31.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53612024-08-30T19:50:31.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53622024-08-30T19:50:31.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53632024-08-30T19:50:31.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53642024-08-30T19:50:31.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53652024-08-30T19:50:31.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53662024-08-30T19:50:31.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53672024-08-30T19:50:31.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53682024-08-30T19:50:31.801ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53692024-08-30T19:50:31.801ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.464019ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53702024-08-30T19:50:31.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53712024-08-30T19:50:31.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53722024-08-30T19:50:31.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53732024-08-30T19:50:31.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53742024-08-30T19:50:31.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53752024-08-30T19:50:31.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53762024-08-30T19:50:31.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.145569ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
53772024-08-30T19:50:31.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53782024-08-30T19:50:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53792024-08-30T19:50:31.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53802024-08-30T19:50:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53812024-08-30T19:50:31.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53822024-08-30T19:50:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53832024-08-30T19:50:31.821ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53842024-08-30T19:50:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53852024-08-30T19:50:31.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.516828ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
53862024-08-30T19:50:31.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.847365ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
53872024-08-30T19:50:31.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.035248ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
53882024-08-30T19:50:31.824ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
53892024-08-30T19:50:31.824ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53902024-08-30T19:50:31.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53912024-08-30T19:50:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53922024-08-30T19:50:31.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932024-08-30T19:50:31.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
53942024-08-30T19:50:31.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53952024-08-30T19:50:31.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53962024-08-30T19:50:31.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972024-08-30T19:50:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53982024-08-30T19:50:31.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53992024-08-30T19:50:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54002024-08-30T19:50:31.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
54012024-08-30T19:50:31.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.81391ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
54022024-08-30T19:50:31.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.56332ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54032024-08-30T19:50:31.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.988608ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54042024-08-30T19:50:31.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54052024-08-30T19:50:31.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
54062024-08-30T19:50:31.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54072024-08-30T19:50:31.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54082024-08-30T19:50:31.860ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.398106ms iteration = 16 status = 0
54092024-08-30T19:50:31.862ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54102024-08-30T19:50:31.862ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54112024-08-30T19:50:31.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.501882ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
54122024-08-30T19:50:31.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
54132024-08-30T19:50:31.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54142024-08-30T19:50:31.880ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5a1507f0-89ec-44d7-81df-039be466ee19", "content-length": "26", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54152024-08-30T19:50:31.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54162024-08-30T19:50:31.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54172024-08-30T19:50:31.882ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
54182024-08-30T19:50:31.882ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54192024-08-30T19:50:31.883ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4fd68056-bf6f-440c-bb4e-aeb7b4791e52", "content-length": "26", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54202024-08-30T19:50:31.883ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54212024-08-30T19:50:31.885ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54222024-08-30T19:50:31.887ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
54232024-08-30T19:50:31.887ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54242024-08-30T19:50:31.887ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b9e1b7ea-ac07-461f-8e4c-e81ed7bdaf8b", "content-length": "26", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54252024-08-30T19:50:31.887ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54262024-08-30T19:50:31.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
54272024-08-30T19:50:31.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54282024-08-30T19:50:31.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54292024-08-30T19:50:31.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54302024-08-30T19:50:31.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54312024-08-30T19:50:31.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54322024-08-30T19:50:31.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54332024-08-30T19:50:31.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54342024-08-30T19:50:31.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54352024-08-30T19:50:31.930ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.173378ms iteration = 19 status = {"physical_disks_added":0}
54362024-08-30T19:50:32.012ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54372024-08-30T19:50:32.012ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c050ca66-c1b1-45df-bb10-f896bd0987cc", "content-length": "2", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54382024-08-30T19:50:32.014ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54392024-08-30T19:50:32.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54402024-08-30T19:50:32.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54412024-08-30T19:50:32.091ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.597248ms iteration = 16 status = null
54422024-08-30T19:50:32.098ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.064201ms iteration = 16 status = {}
54432024-08-30T19:50:32.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54442024-08-30T19:50:32.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54452024-08-30T19:50:32.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54462024-08-30T19:50:32.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54472024-08-30T19:50:32.124ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1dd24eb-7728-4be6-b1a2-a44d8f2057e0", "content-length": "372", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54482024-08-30T19:50:32.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54492024-08-30T19:50:32.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54502024-08-30T19:50:32.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54512024-08-30T19:50:32.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54522024-08-30T19:50:32.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54532024-08-30T19:50:32.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54542024-08-30T19:50:32.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54552024-08-30T19:50:32.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54562024-08-30T19:50:32.132ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
54572024-08-30T19:50:32.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54582024-08-30T19:50:32.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54592024-08-30T19:50:32.133ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54602024-08-30T19:50:32.134ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e5e69ae6-abb6-407a-9d68-4fc6eb5dd972", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54612024-08-30T19:50:32.136ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.748505ms iteration = 18 status = {}
54622024-08-30T19:50:32.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54632024-08-30T19:50:32.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "de38f88a-77a4-4eed-b3ff-261da1844584", "content-length": "121", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54642024-08-30T19:50:32.145ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
54652024-08-30T19:50:32.146ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
54662024-08-30T19:50:32.146ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54672024-08-30T19:50:32.146ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54682024-08-30T19:50:32.146ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
54692024-08-30T19:50:32.146ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
54702024-08-30T19:50:32.146ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
54712024-08-30T19:50:32.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54722024-08-30T19:50:32.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54732024-08-30T19:50:32.148ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54742024-08-30T19:50:32.148ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "28aaf9f7-df61-4c8a-b9c5-8a9b66901cdf", "content-length": "2", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54752024-08-30T19:50:32.148ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54762024-08-30T19:50:32.148ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4d0ebb5f-08d9-4b6a-b781-d8e7b98c23d0", "content-length": "52", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54772024-08-30T19:50:32.148ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
54782024-08-30T19:50:32.148ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54792024-08-30T19:50:32.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54802024-08-30T19:50:32.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e293e50d-47f2-41f8-ae3f-d013852b5df9", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54812024-08-30T19:50:32.242ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
54822024-08-30T19:50:32.242ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54832024-08-30T19:50:32.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a498f409-7b39-4130-945a-efe23d4cce52 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
54842024-08-30T19:50:32.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a498f409-7b39-4130-945a-efe23d4cce52 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
54852024-08-30T19:50:32.243ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c824cdf9-89ad-4234-a4ed-1cac3e24e445", "content-length": "667", "date": "Fri, 30 Aug 2024 19:50:32 GMT"} })
54862024-08-30T19:50:32.243ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4dfbe15a-e4a5-410b-90ef-a0179d4758ba", "content-length": "691", "date": "Fri, 30 Aug 2024 19:50:31 GMT"} })
54872024-08-30T19:50:32.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54882024-08-30T19:50:32.243ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54892024-08-30T19:50:32.243ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54902024-08-30T19:50:32.243ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54912024-08-30T19:50:32.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54922024-08-30T19:50:32.245ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.722818ms iteration = 17 status = {}
54932024-08-30T19:50:32.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a498f409-7b39-4130-945a-efe23d4cce52 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
54942024-08-30T19:50:32.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54952024-08-30T19:50:32.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54962024-08-30T19:50:32.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54972024-08-30T19:50:32.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54982024-08-30T19:50:32.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54992024-08-30T19:50:32.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55002024-08-30T19:50:32.258ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 484.848778ms iteration = 16 status = {}
55012024-08-30T19:50:33.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5750a0c1-84cc-4631-a86f-cc304aa8aea7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55022024-08-30T19:50:33.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5750a0c1-84cc-4631-a86f-cc304aa8aea7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55032024-08-30T19:50:33.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5750a0c1-84cc-4631-a86f-cc304aa8aea7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55042024-08-30T19:50:34.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52588fb6-ed0e-46dd-8561-63cc08fb1489 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55052024-08-30T19:50:34.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52588fb6-ed0e-46dd-8561-63cc08fb1489 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55062024-08-30T19:50:34.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 52588fb6-ed0e-46dd-8561-63cc08fb1489 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55072024-08-30T19:50:35.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d2893a0a-fc38-455f-bb0e-2b32126932e8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55082024-08-30T19:50:35.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d2893a0a-fc38-455f-bb0e-2b32126932e8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55092024-08-30T19:50:35.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d2893a0a-fc38-455f-bb0e-2b32126932e8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55102024-08-30T19:50:36.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3bc937dc-e606-4d53-93e8-4020069f565c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55112024-08-30T19:50:36.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3bc937dc-e606-4d53-93e8-4020069f565c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55122024-08-30T19:50:36.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3bc937dc-e606-4d53-93e8-4020069f565c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55132024-08-30T19:50:37.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bdf8c57b-f04d-4c4b-ba1c-69c05431fea2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55142024-08-30T19:50:37.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bdf8c57b-f04d-4c4b-ba1c-69c05431fea2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55152024-08-30T19:50:37.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bdf8c57b-f04d-4c4b-ba1c-69c05431fea2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55162024-08-30T19:50:38.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 843a6f4f-a076-4cf0-9589-6c359d8692f0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55172024-08-30T19:50:38.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 843a6f4f-a076-4cf0-9589-6c359d8692f0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55182024-08-30T19:50:38.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 843a6f4f-a076-4cf0-9589-6c359d8692f0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55192024-08-30T19:50:39.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 54f52a33-2743-4b2c-a2d3-4d41a99d6264 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55202024-08-30T19:50:39.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 54f52a33-2743-4b2c-a2d3-4d41a99d6264 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55212024-08-30T19:50:39.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 54f52a33-2743-4b2c-a2d3-4d41a99d6264 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55222024-08-30T19:50:40.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 06d23abd-c992-49b8-9c14-40cfc55dd5f9 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
55232024-08-30T19:50:40.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 251f7401-cc00-4b10-ae1f-82f16f13ec3e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55242024-08-30T19:50:40.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 251f7401-cc00-4b10-ae1f-82f16f13ec3e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55252024-08-30T19:50:40.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 251f7401-cc00-4b10-ae1f-82f16f13ec3e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55262024-08-30T19:50:41.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4abd6ab1-4d7a-46e0-9d2a-582089b6f48e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55272024-08-30T19:50:41.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4abd6ab1-4d7a-46e0-9d2a-582089b6f48e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55282024-08-30T19:50:41.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4abd6ab1-4d7a-46e0-9d2a-582089b6f48e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55292024-08-30T19:50:41.774ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
55302024-08-30T19:50:41.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
55312024-08-30T19:50:41.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55322024-08-30T19:50:41.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55332024-08-30T19:50:41.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55342024-08-30T19:50:41.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55352024-08-30T19:50:41.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55362024-08-30T19:50:41.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55372024-08-30T19:50:41.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55382024-08-30T19:50:41.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55392024-08-30T19:50:41.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55402024-08-30T19:50:41.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55412024-08-30T19:50:41.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55422024-08-30T19:50:41.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55432024-08-30T19:50:41.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-08-30T19:50:41.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
55452024-08-30T19:50:41.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55462024-08-30T19:50:41.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55472024-08-30T19:50:41.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
55482024-08-30T19:50:41.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.131964ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
55492024-08-30T19:50:41.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.422633ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55502024-08-30T19:50:42.420ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53170
55512024-08-30T19:50:42.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53170 req_id = ea34c739-95a6-4cb4-9100-6a2ed3fd2c1b roles = RoleSet { roles: {} } uri = /metrics/producers
55522024-08-30T19:50:42.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53170 req_id = ea34c739-95a6-4cb4-9100-6a2ed3fd2c1b resource = Database result = Ok(()) uri = /metrics/producers
55532024-08-30T19:50:42.454ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
55542024-08-30T19:50:42.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53170 req_id = ea34c739-95a6-4cb4-9100-6a2ed3fd2c1b roles = RoleSet { roles: {} } uri = /metrics/producers
55552024-08-30T19:50:42.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53170 req_id = ea34c739-95a6-4cb4-9100-6a2ed3fd2c1b resource = Database result = Ok(()) uri = /metrics/producers
55562024-08-30T19:50:42.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 37bdf772-f583-4904-a67c-75c1bb012cfe roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55572024-08-30T19:50:42.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 37bdf772-f583-4904-a67c-75c1bb012cfe resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55582024-08-30T19:50:42.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 37bdf772-f583-4904-a67c-75c1bb012cfe response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55592024-08-30T19:50:42.484ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
55602024-08-30T19:50:42.484ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ff1ded84-8d41-4e17-95a6-b86618e5138e", "date": "Fri, 30 Aug 2024 19:50:42 GMT"} })
55612024-08-30T19:50:42.484ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 1a27df0f-5b46-452b-9341-ffa1d189a587
55622024-08-30T19:50:42.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65966 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53170 req_id = ea34c739-95a6-4cb4-9100-6a2ed3fd2c1b response_code = 201 uri = /metrics/producers
55632024-08-30T19:50:43.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5aae67bd-f64e-4404-b416-4ddcfd98e50f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55642024-08-30T19:50:43.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5aae67bd-f64e-4404-b416-4ddcfd98e50f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55652024-08-30T19:50:43.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5aae67bd-f64e-4404-b416-4ddcfd98e50f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55662024-08-30T19:50:44.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4acdc60f-767e-4556-952c-258010e6c487 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55672024-08-30T19:50:44.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4acdc60f-767e-4556-952c-258010e6c487 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55682024-08-30T19:50:44.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4acdc60f-767e-4556-952c-258010e6c487 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55692024-08-30T19:50:44.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 52c444cf-640f-484b-8725-b9304d17d7b8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
55702024-08-30T19:50:44.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 52c444cf-640f-484b-8725-b9304d17d7b8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
55712024-08-30T19:50:44.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 52c444cf-640f-484b-8725-b9304d17d7b8 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
55722024-08-30T19:50:45.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 088de73c-0d56-4b88-b39d-353ff84c4a01 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55732024-08-30T19:50:45.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 088de73c-0d56-4b88-b39d-353ff84c4a01 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55742024-08-30T19:50:45.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 088de73c-0d56-4b88-b39d-353ff84c4a01 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55752024-08-30T19:50:46.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9c5d793f-0c06-4c81-9f9c-2aabc0a510a4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55762024-08-30T19:50:46.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9c5d793f-0c06-4c81-9f9c-2aabc0a510a4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55772024-08-30T19:50:46.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 9c5d793f-0c06-4c81-9f9c-2aabc0a510a4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55782024-08-30T19:50:47.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf0b6ed5-084d-41f3-8785-08e3c0770253 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55792024-08-30T19:50:47.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf0b6ed5-084d-41f3-8785-08e3c0770253 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55802024-08-30T19:50:47.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf0b6ed5-084d-41f3-8785-08e3c0770253 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55812024-08-30T19:50:48.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ef3210e4-1c79-4271-823c-4899d43ac0a6 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55822024-08-30T19:50:48.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ef3210e4-1c79-4271-823c-4899d43ac0a6 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55832024-08-30T19:50:48.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ef3210e4-1c79-4271-823c-4899d43ac0a6 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55842024-08-30T19:50:49.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 720428bf-3f2f-46f6-9667-54476f039eba roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55852024-08-30T19:50:49.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 720428bf-3f2f-46f6-9667-54476f039eba resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55862024-08-30T19:50:49.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 720428bf-3f2f-46f6-9667-54476f039eba response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
55872024-08-30T19:50:50.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1494 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = acfb5969-1ae4-48f2-9e0b-cf8a9a0443e5 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
55882024-08-30T19:50:50.170ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
55892024-08-30T19:50:50.170ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
55902024-08-30T19:50:50.201ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
55912024-08-30T19:50:50.201ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:65122
55922024-08-30T19:50:50.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65122 req_id = 407d555d-46e4-4c9c-aafa-cc0298617c67 roles = RoleSet { roles: {} } uri = /metrics/producers
55932024-08-30T19:50:50.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65122 req_id = 407d555d-46e4-4c9c-aafa-cc0298617c67 resource = Database result = Ok(()) uri = /metrics/producers
55942024-08-30T19:50:50.236ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
55952024-08-30T19:50:50.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65122 req_id = 407d555d-46e4-4c9c-aafa-cc0298617c67 roles = RoleSet { roles: {} } uri = /metrics/producers
55962024-08-30T19:50:50.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65122 req_id = 407d555d-46e4-4c9c-aafa-cc0298617c67 resource = Database result = Ok(()) uri = /metrics/producers
55972024-08-30T19:50:50.273ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
55982024-08-30T19:50:50.274ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "83249b04-995f-4f7d-a276-544345b1e0e0", "date": "Fri, 30 Aug 2024 19:50:50 GMT"} })
55992024-08-30T19:50:50.274ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 1d96d476-acdb-4c44-a486-29569b3bf41e
56002024-08-30T19:50:50.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74516 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65122 req_id = 407d555d-46e4-4c9c-aafa-cc0298617c67 response_code = 201 uri = /metrics/producers
56012024-08-30T19:50:50.275ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "407d555d-46e4-4c9c-aafa-cc0298617c67", "content-length": "41", "date": "Fri, 30 Aug 2024 19:50:50 GMT"} })
56022024-08-30T19:50:50.278ZDEBGnexus (producer-registration-task): registered with nexus successfully
56032024-08-30T19:50:50.278ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
56042024-08-30T19:50:50.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5cf28131-1e4b-42f7-9dcc-3eedb25cf3a3 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56052024-08-30T19:50:50.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5cf28131-1e4b-42f7-9dcc-3eedb25cf3a3 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56062024-08-30T19:50:50.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5cf28131-1e4b-42f7-9dcc-3eedb25cf3a3 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56072024-08-30T19:50:51.566ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56612
56082024-08-30T19:50:51.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56612 req_id = 94750fed-beab-4cfe-96cb-bd7246f3b018 roles = RoleSet { roles: {} } uri = /metrics/producers
56092024-08-30T19:50:51.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56612 req_id = 94750fed-beab-4cfe-96cb-bd7246f3b018 resource = Database result = Ok(()) uri = /metrics/producers
56102024-08-30T19:50:51.600ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
56112024-08-30T19:50:51.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56612 req_id = 94750fed-beab-4cfe-96cb-bd7246f3b018 roles = RoleSet { roles: {} } uri = /metrics/producers
56122024-08-30T19:50:51.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56612 req_id = 94750fed-beab-4cfe-96cb-bd7246f3b018 resource = Database result = Ok(()) uri = /metrics/producers
56132024-08-30T19:50:51.632ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
56142024-08-30T19:50:51.633ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9080d343-51a2-441a-95c7-990c79c6a6d6", "date": "Fri, 30 Aug 2024 19:50:51 GMT"} })
56152024-08-30T19:50:51.633ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 97bafd33-1efa-47dd-ad8d-79adc978f835
56162024-08-30T19:50:51.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 67408 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56612 req_id = 94750fed-beab-4cfe-96cb-bd7246f3b018 response_code = 201 uri = /metrics/producers
56172024-08-30T19:50:51.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b8638998-f46b-41d9-9f03-e2ad03f7e322 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56182024-08-30T19:50:51.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b8638998-f46b-41d9-9f03-e2ad03f7e322 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56192024-08-30T19:50:51.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b8638998-f46b-41d9-9f03-e2ad03f7e322 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56202024-08-30T19:50:51.773ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
56212024-08-30T19:50:51.773ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
56222024-08-30T19:50:51.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56232024-08-30T19:50:51.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56242024-08-30T19:50:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56252024-08-30T19:50:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56262024-08-30T19:50:51.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56272024-08-30T19:50:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56282024-08-30T19:50:51.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56292024-08-30T19:50:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56302024-08-30T19:50:51.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56312024-08-30T19:50:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56322024-08-30T19:50:51.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56332024-08-30T19:50:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
56342024-08-30T19:50:51.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56352024-08-30T19:50:51.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56362024-08-30T19:50:51.792ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
56372024-08-30T19:50:51.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.975583ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
56382024-08-30T19:50:51.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56392024-08-30T19:50:51.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56402024-08-30T19:50:51.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.425285ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56412024-08-30T19:50:52.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47b1ec5a-4d99-472b-9976-1af5f88f3647 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56422024-08-30T19:50:52.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47b1ec5a-4d99-472b-9976-1af5f88f3647 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56432024-08-30T19:50:52.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 47b1ec5a-4d99-472b-9976-1af5f88f3647 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56442024-08-30T19:50:53.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b3f543ab-39ea-465d-aca6-d6a3cbd20c46 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56452024-08-30T19:50:53.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b3f543ab-39ea-465d-aca6-d6a3cbd20c46 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56462024-08-30T19:50:53.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b3f543ab-39ea-465d-aca6-d6a3cbd20c46 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56472024-08-30T19:50:54.007ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45177
56482024-08-30T19:50:54.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45177 req_id = 862bfb30-af67-49b9-afc1-e0715bee38b9 roles = RoleSet { roles: {} } uri = /metrics/producers
56492024-08-30T19:50:54.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45177 req_id = 862bfb30-af67-49b9-afc1-e0715bee38b9 resource = Database result = Ok(()) uri = /metrics/producers
56502024-08-30T19:50:54.047ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
56512024-08-30T19:50:54.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45177 req_id = 862bfb30-af67-49b9-afc1-e0715bee38b9 roles = RoleSet { roles: {} } uri = /metrics/producers
56522024-08-30T19:50:54.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45177 req_id = 862bfb30-af67-49b9-afc1-e0715bee38b9 resource = Database result = Ok(()) uri = /metrics/producers
56532024-08-30T19:50:54.052ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
56542024-08-30T19:50:54.053ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "34eb3463-cb8b-43be-a3a6-d2ab390c5789", "date": "Fri, 30 Aug 2024 19:50:54 GMT"} })
56552024-08-30T19:50:54.053ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = ed7080f3-1d98-4020-99f0-be3df73052de
56562024-08-30T19:50:54.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 47469 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45177 req_id = 862bfb30-af67-49b9-afc1-e0715bee38b9 response_code = 201 uri = /metrics/producers
56572024-08-30T19:50:54.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2f04aaa7-3770-48d6-921d-26d97175984a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56582024-08-30T19:50:54.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2f04aaa7-3770-48d6-921d-26d97175984a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56592024-08-30T19:50:54.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2f04aaa7-3770-48d6-921d-26d97175984a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56602024-08-30T19:50:55.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d961ff08-2943-43fb-aea6-77ae6051e446 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56612024-08-30T19:50:55.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d961ff08-2943-43fb-aea6-77ae6051e446 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56622024-08-30T19:50:55.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d961ff08-2943-43fb-aea6-77ae6051e446 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56632024-08-30T19:50:56.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8ac14796-3072-436d-a0f9-b315e5130740 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56642024-08-30T19:50:56.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8ac14796-3072-436d-a0f9-b315e5130740 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56652024-08-30T19:50:56.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8ac14796-3072-436d-a0f9-b315e5130740 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56662024-08-30T19:50:57.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a5671a35-c152-406e-8929-9f045a4ae61f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56672024-08-30T19:50:57.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a5671a35-c152-406e-8929-9f045a4ae61f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56682024-08-30T19:50:57.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a5671a35-c152-406e-8929-9f045a4ae61f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56692024-08-30T19:50:58.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 977c2f3f-e865-40e6-8232-a0692d3c6325 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56702024-08-30T19:50:58.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 977c2f3f-e865-40e6-8232-a0692d3c6325 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56712024-08-30T19:50:58.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 977c2f3f-e865-40e6-8232-a0692d3c6325 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56722024-08-30T19:50:59.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2ea00c18-b816-4335-80a6-03abfcdfea97 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56732024-08-30T19:50:59.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2ea00c18-b816-4335-80a6-03abfcdfea97 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56742024-08-30T19:50:59.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2ea00c18-b816-4335-80a6-03abfcdfea97 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56752024-08-30T19:51:00.277ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 992a53f7-11bf-426c-bccd-1a422a380260 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
56762024-08-30T19:51:00.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 01345adb-c8d1-4eb7-a440-db015ddd268f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56772024-08-30T19:51:00.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 01345adb-c8d1-4eb7-a440-db015ddd268f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56782024-08-30T19:51:00.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 01345adb-c8d1-4eb7-a440-db015ddd268f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
56792024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
56802024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
56812024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
56822024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56832024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56842024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
56852024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
56862024-08-30T19:51:01.773ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-30 19:41:01.773704067 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56872024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56882024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
56892024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
56902024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56912024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
56922024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56932024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
56942024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56952024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
56962024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
56972024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
56982024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56992024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
57002024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57012024-08-30T19:51:01.773ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
57022024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57032024-08-30T19:51:01.773ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57042024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
57052024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57062024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
57072024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57082024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
57092024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57102024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
57112024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57122024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57132024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
57142024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
57152024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57162024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57172024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
57182024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57192024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
57202024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
57212024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57222024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57232024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
57242024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57252024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
57262024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57272024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
57282024-08-30T19:51:01.774ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57292024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57302024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
57312024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
57322024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57332024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57342024-08-30T19:51:01.774ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25
57352024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
57362024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.66\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25"}
57372024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
57382024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57392024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57402024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57412024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57422024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57432024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57442024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57452024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57462024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
57472024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57482024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57492024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57502024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57512024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57522024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57532024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57542024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57552024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57562024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57572024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57582024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57592024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57602024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57612024-08-30T19:51:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57622024-08-30T19:51:01.776ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5636b10-76ec-4aa4-8bd4-1f95780813df.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff52340f-525a-4b88-bfc8-1cb0fe9ceba7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 79827343 } })
57632024-08-30T19:51:01.776ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8b642bba-10a6-428b-9af7-48d5f8622e03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5d7b957-0082-4dc3-b742-d6e7150a43c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c4910af2-5760-4c5f-bb62-3b2357eab858.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 80050617 } })
57642024-08-30T19:51:01.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57652024-08-30T19:51:01.777ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-30 19:41:01.773704067 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
57662024-08-30T19:51:01.777ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.736976ms iteration = 9 status = {"expiration":"2024-08-30T19:41:01.773704067Z","pruned":[]}
57672024-08-30T19:51:01.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57682024-08-30T19:51:01.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57692024-08-30T19:51:01.778ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
57702024-08-30T19:51:01.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.179753ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
57712024-08-30T19:51:01.778ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.0925ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57722024-08-30T19:51:01.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 82804165 } })
57732024-08-30T19:51:01.779ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
57742024-08-30T19:51:01.779ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.549417ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
57752024-08-30T19:51:01.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57762024-08-30T19:51:01.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57772024-08-30T19:51:01.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57782024-08-30T19:51:01.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
57792024-08-30T19:51:01.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57802024-08-30T19:51:01.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57812024-08-30T19:51:01.782ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.818934ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
57822024-08-30T19:51:01.782ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 86484390 } })
57832024-08-30T19:51:01.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
57842024-08-30T19:51:01.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57852024-08-30T19:51:01.784ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57862024-08-30T19:51:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57872024-08-30T19:51:01.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57882024-08-30T19:51:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57892024-08-30T19:51:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57902024-08-30T19:51:01.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57912024-08-30T19:51:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57922024-08-30T19:51:01.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57932024-08-30T19:51:01.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57942024-08-30T19:51:01.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57952024-08-30T19:51:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57962024-08-30T19:51:01.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57972024-08-30T19:51:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57982024-08-30T19:51:01.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57992024-08-30T19:51:01.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58002024-08-30T19:51:01.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58012024-08-30T19:51:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58022024-08-30T19:51:01.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58032024-08-30T19:51:01.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58042024-08-30T19:51:01.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58052024-08-30T19:51:01.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58062024-08-30T19:51:01.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58072024-08-30T19:51:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58082024-08-30T19:51:01.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58092024-08-30T19:51:01.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58102024-08-30T19:51:01.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 121889161 } })
58112024-08-30T19:51:01.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
58122024-08-30T19:51:01.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58132024-08-30T19:51:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58142024-08-30T19:51:01.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.399087ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
58152024-08-30T19:51:01.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.601526ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
58162024-08-30T19:51:01.835ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58172024-08-30T19:51:01.835ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58182024-08-30T19:51:01.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58192024-08-30T19:51:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58202024-08-30T19:51:01.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58212024-08-30T19:51:01.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58222024-08-30T19:51:01.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58232024-08-30T19:51:01.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58242024-08-30T19:51:01.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58252024-08-30T19:51:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58262024-08-30T19:51:01.845ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-08-30T19:51:01.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58282024-08-30T19:51:01.846ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58292024-08-30T19:51:01.846ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58302024-08-30T19:51:01.846ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58312024-08-30T19:51:01.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58322024-08-30T19:51:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58332024-08-30T19:51:01.847ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
58342024-08-30T19:51:01.847ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
58352024-08-30T19:51:01.847ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.54539ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
58362024-08-30T19:51:01.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58372024-08-30T19:51:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58382024-08-30T19:51:01.848ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58392024-08-30T19:51:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58402024-08-30T19:51:01.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58412024-08-30T19:51:01.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58422024-08-30T19:51:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58432024-08-30T19:51:01.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58442024-08-30T19:51:01.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58452024-08-30T19:51:01.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58462024-08-30T19:51:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58472024-08-30T19:51:01.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58482024-08-30T19:51:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58492024-08-30T19:51:01.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58502024-08-30T19:51:01.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58512024-08-30T19:51:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58522024-08-30T19:51:01.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58532024-08-30T19:51:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58542024-08-30T19:51:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58552024-08-30T19:51:01.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
58562024-08-30T19:51:01.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58572024-08-30T19:51:01.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58582024-08-30T19:51:01.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.483105ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58592024-08-30T19:51:01.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58602024-08-30T19:51:01.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58612024-08-30T19:51:01.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58622024-08-30T19:51:01.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58632024-08-30T19:51:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58642024-08-30T19:51:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58652024-08-30T19:51:01.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58662024-08-30T19:51:01.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58672024-08-30T19:51:01.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58682024-08-30T19:51:01.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58692024-08-30T19:51:01.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58702024-08-30T19:51:01.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58712024-08-30T19:51:01.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.137796ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
58722024-08-30T19:51:01.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58732024-08-30T19:51:01.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58742024-08-30T19:51:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
58752024-08-30T19:51:01.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58762024-08-30T19:51:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58772024-08-30T19:51:01.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
58782024-08-30T19:51:01.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58792024-08-30T19:51:01.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58802024-08-30T19:51:01.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.577852ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58812024-08-30T19:51:01.872ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.525998ms iteration = 17 status = 0
58822024-08-30T19:51:01.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58832024-08-30T19:51:01.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.614818ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58842024-08-30T19:51:01.883ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58852024-08-30T19:51:01.883ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58862024-08-30T19:51:01.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.866478ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
58872024-08-30T19:51:01.884ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
58882024-08-30T19:51:01.884ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.035361ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
58892024-08-30T19:51:01.888ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58902024-08-30T19:51:01.888ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58912024-08-30T19:51:01.888ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.049862ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58922024-08-30T19:51:01.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a3b509dc-10fe-4d12-9d71-358a020c62e0 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
58932024-08-30T19:51:01.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a3b509dc-10fe-4d12-9d71-358a020c62e0 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
58942024-08-30T19:51:01.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a3b509dc-10fe-4d12-9d71-358a020c62e0 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
58952024-08-30T19:51:01.891ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58962024-08-30T19:51:01.891ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58972024-08-30T19:51:01.891ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58982024-08-30T19:51:01.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58992024-08-30T19:51:01.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59002024-08-30T19:51:01.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012024-08-30T19:51:01.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59022024-08-30T19:51:01.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59032024-08-30T19:51:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59042024-08-30T19:51:01.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59052024-08-30T19:51:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59062024-08-30T19:51:01.898ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59072024-08-30T19:51:01.898ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 0 version = 2
59082024-08-30T19:51:01.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59092024-08-30T19:51:01.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59102024-08-30T19:51:01.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59112024-08-30T19:51:01.899ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59122024-08-30T19:51:01.899ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59132024-08-30T19:51:01.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59142024-08-30T19:51:01.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59152024-08-30T19:51:01.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59162024-08-30T19:51:01.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59172024-08-30T19:51:01.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59182024-08-30T19:51:01.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59192024-08-30T19:51:01.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59202024-08-30T19:51:01.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59212024-08-30T19:51:01.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59222024-08-30T19:51:01.909ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4da9b8e7-9c0b-4448-afde-f83fab0eb20b dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
59232024-08-30T19:51:01.909ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
59242024-08-30T19:51:01.909ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-30 19:43:16.884603 UTC dns_group = internal generation = 1
59252024-08-30T19:51:01.909ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 135.856274ms iteration = 10 status = {"generation":1}
59262024-08-30T19:51:01.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.104811ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59272024-08-30T19:51:01.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59282024-08-30T19:51:01.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59292024-08-30T19:51:01.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59302024-08-30T19:51:01.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59312024-08-30T19:51:01.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59322024-08-30T19:51:01.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59332024-08-30T19:51:01.941ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-30T19:42:58.455639Z, time_modified: 2024-08-30T19:42:58.455639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: aa09ea70-5935-4726-aa8b-daae29285c7a, db_silo: Silo { identity: SiloIdentity { id: aa09ea70-5935-4726-aa8b-daae29285c7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-30T19:43:18.290633Z, time_modified: 2024-08-30T19:43:18.290633Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189" }] }) }
59342024-08-30T19:51:01.941ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.730483ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]}},"default_endpoint":{"silo_id":"aa09ea70-5935-4726-aa8b-daae29285c7a","tls_certs":["3c866038d66bab74a40e61f6620010bb5e0f64344fb4d1705ff0d1538af8c189"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59352024-08-30T19:51:01.943ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7f52d615-4a25-43b0-878f-65d4872e4324 dns_zone_name = oxide.test found_so_far = 1 version = 2
59362024-08-30T19:51:01.943ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59372024-08-30T19:51:01.943ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-30 19:43:18.363870 UTC dns_group = external generation = 2
59382024-08-30T19:51:01.943ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 169.624237ms iteration = 10 status = {"generation":2}
59392024-08-30T19:51:01.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
59402024-08-30T19:51:01.956ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59412024-08-30T19:51:01.956ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92239986-3d17-4d11-b8de-4d6f6cd6778c", "content-length": "26", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
59422024-08-30T19:51:01.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59432024-08-30T19:51:01.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
59442024-08-30T19:51:01.957ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59452024-08-30T19:51:01.957ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5246650b-ee10-480a-87ee-75fb4f8568b2", "content-length": "26", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
59462024-08-30T19:51:01.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59472024-08-30T19:51:01.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59482024-08-30T19:51:01.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59492024-08-30T19:51:01.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
59502024-08-30T19:51:01.962ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59512024-08-30T19:51:01.962ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0afccd3f-1df5-4586-91ef-ec7c696b650a", "content-length": "26", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
59522024-08-30T19:51:01.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59532024-08-30T19:51:01.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
59542024-08-30T19:51:01.970ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.58577ms iteration = 20 status = {"physical_disks_added":0}
59552024-08-30T19:51:02.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59562024-08-30T19:51:02.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59572024-08-30T19:51:02.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59582024-08-30T19:51:02.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59592024-08-30T19:51:02.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59602024-08-30T19:51:02.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59612024-08-30T19:51:02.026ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
59622024-08-30T19:51:02.086ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59632024-08-30T19:51:02.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59642024-08-30T19:51:02.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9a0c3f8-8ee2-4f71-9918-a1305103605b", "content-length": "372", "date": "Fri, 30 Aug 2024 19:51:02 GMT"} })
59652024-08-30T19:51:02.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59662024-08-30T19:51:02.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59672024-08-30T19:51:02.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59682024-08-30T19:51:02.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59692024-08-30T19:51:02.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59702024-08-30T19:51:02.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59712024-08-30T19:51:02.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59722024-08-30T19:51:02.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59732024-08-30T19:51:02.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59742024-08-30T19:51:02.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59752024-08-30T19:51:02.098ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59762024-08-30T19:51:02.098ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "10fbbeb1-75e4-454f-bced-c82cad44389f", "date": "Fri, 30 Aug 2024 19:51:02 GMT"} })
59772024-08-30T19:51:02.100ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 326.612471ms iteration = 19 status = {}
59782024-08-30T19:51:02.116ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 342.383108ms iteration = 17 status = {}
59792024-08-30T19:51:02.125ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59802024-08-30T19:51:02.125ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4e0f7dfd-5942-40e7-8cbe-5cb70102a3ba", "content-length": "2", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
59812024-08-30T19:51:02.127ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59822024-08-30T19:51:02.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59832024-08-30T19:51:02.130ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 356.526187ms iteration = 17 status = null
59842024-08-30T19:51:02.260ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59852024-08-30T19:51:02.281ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd423e58-e142-4816-9f53-632ba048c9c2", "content-length": "691", "date": "Fri, 30 Aug 2024 19:51:02 GMT"} })
59862024-08-30T19:51:02.281ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59872024-08-30T19:51:02.281ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59882024-08-30T19:51:02.282ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59892024-08-30T19:51:02.283ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 509.642783ms iteration = 18 status = {}
59902024-08-30T19:51:02.286ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59912024-08-30T19:51:02.316ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59922024-08-30T19:51:02.317ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fcd54b56-0120-416c-a5b7-abfd2386804a", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59932024-08-30T19:51:02.317ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59942024-08-30T19:51:02.318ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "02e64176-86e4-4520-aac8-e7c087bf7018", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59952024-08-30T19:51:02.318ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59962024-08-30T19:51:02.319ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59972024-08-30T19:51:02.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 546.302906ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59982024-08-30T19:51:02.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59992024-08-30T19:51:02.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60002024-08-30T19:51:02.348ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
60012024-08-30T19:51:02.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60022024-08-30T19:51:02.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60032024-08-30T19:51:02.356ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60042024-08-30T19:51:02.356ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60ab8e78-f0a9-4d8a-b5a1-9f6fb0d2420d", "content-length": "121", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
60052024-08-30T19:51:02.356ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
60062024-08-30T19:51:02.356ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
60072024-08-30T19:51:02.356ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60082024-08-30T19:51:02.356ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60092024-08-30T19:51:02.356ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
60102024-08-30T19:51:02.356ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
60112024-08-30T19:51:02.356ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
60122024-08-30T19:51:02.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60132024-08-30T19:51:02.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60142024-08-30T19:51:02.358ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60152024-08-30T19:51:02.359ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "93ce2ee5-12e6-4a62-9def-ec96ac6b6199", "content-length": "2", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
60162024-08-30T19:51:02.359ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60172024-08-30T19:51:02.359ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1500e62d-8500-4464-949d-229897a1ef62", "content-length": "52", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
60182024-08-30T19:51:02.359ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
60192024-08-30T19:51:02.359ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60202024-08-30T19:51:02.359ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60212024-08-30T19:51:02.360ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9da32223-5241-414a-83db-82876510a174", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60222024-08-30T19:51:02.360ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60232024-08-30T19:51:02.362ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f1b3ab10-50bb-48ae-88fa-a272eda84255", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60242024-08-30T19:51:02.362ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60252024-08-30T19:51:02.364ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4a53c1b0-aadc-47ee-8046-cdd1d6560518", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60262024-08-30T19:51:02.364ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60272024-08-30T19:51:02.366ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60282024-08-30T19:51:02.366ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 592.757191ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60292024-08-30T19:51:02.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "208b3975-856c-40db-997c-40187daf879f", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
60302024-08-30T19:51:02.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
60312024-08-30T19:51:02.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60322024-08-30T19:51:02.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "763d9d3f-1f11-4127-8865-577d8fcf687b", "content-length": "667", "date": "Fri, 30 Aug 2024 19:51:01 GMT"} })
60332024-08-30T19:51:02.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60342024-08-30T19:51:02.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60352024-08-30T19:51:02.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60362024-08-30T19:51:02.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60372024-08-30T19:51:02.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60382024-08-30T19:51:02.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60392024-08-30T19:51:02.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60402024-08-30T19:51:02.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60412024-08-30T19:51:02.469ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 696.133226ms iteration = 17 status = {}
60422024-08-30T19:51:02.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 110fc34a-d953-4088-ac5b-67764a2debd7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60432024-08-30T19:51:02.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 110fc34a-d953-4088-ac5b-67764a2debd7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60442024-08-30T19:51:02.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 110fc34a-d953-4088-ac5b-67764a2debd7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60452024-08-30T19:51:02.972ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37092
60462024-08-30T19:51:02.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37092 req_id = d4e82764-6c0e-41e1-bad9-05d6add9f1ed roles = RoleSet { roles: {} } uri = /metrics/producers
60472024-08-30T19:51:02.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37092 req_id = d4e82764-6c0e-41e1-bad9-05d6add9f1ed resource = Database result = Ok(()) uri = /metrics/producers
60482024-08-30T19:51:03.005ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
60492024-08-30T19:51:03.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37092 req_id = d4e82764-6c0e-41e1-bad9-05d6add9f1ed roles = RoleSet { roles: {} } uri = /metrics/producers
60502024-08-30T19:51:03.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37092 req_id = d4e82764-6c0e-41e1-bad9-05d6add9f1ed resource = Database result = Ok(()) uri = /metrics/producers
60512024-08-30T19:51:03.010ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
60522024-08-30T19:51:03.010ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2ee8f24b-5fc1-432c-b825-89b1aaae4d66", "date": "Fri, 30 Aug 2024 19:51:03 GMT"} })
60532024-08-30T19:51:03.010ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 215857b3-317f-4a74-b078-672feeaa0d1e
60542024-08-30T19:51:03.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39006 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37092 req_id = d4e82764-6c0e-41e1-bad9-05d6add9f1ed response_code = 201 uri = /metrics/producers
60552024-08-30T19:51:03.264ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:48732
60562024-08-30T19:51:03.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48732 req_id = 43ea73ae-2e95-477e-a70d-512550a173b9 roles = RoleSet { roles: {} } uri = /metrics/producers
60572024-08-30T19:51:03.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48732 req_id = 43ea73ae-2e95-477e-a70d-512550a173b9 resource = Database result = Ok(()) uri = /metrics/producers
60582024-08-30T19:51:03.296ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
60592024-08-30T19:51:03.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48732 req_id = 43ea73ae-2e95-477e-a70d-512550a173b9 roles = RoleSet { roles: {} } uri = /metrics/producers
60602024-08-30T19:51:03.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48732 req_id = 43ea73ae-2e95-477e-a70d-512550a173b9 resource = Database result = Ok(()) uri = /metrics/producers
60612024-08-30T19:51:03.326ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
60622024-08-30T19:51:03.326ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "986332cf-8028-4562-9a03-1bf764d3a88c", "date": "Fri, 30 Aug 2024 19:51:03 GMT"} })
60632024-08-30T19:51:03.326ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = 289c9d10-fa69-4638-aac7-3cfc6b4e23be
60642024-08-30T19:51:03.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63418 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48732 req_id = 43ea73ae-2e95-477e-a70d-512550a173b9 response_code = 201 uri = /metrics/producers
60652024-08-30T19:51:03.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c4367bd-5eb4-4a4b-8e32-60b8ded8ee35 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60662024-08-30T19:51:03.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c4367bd-5eb4-4a4b-8e32-60b8ded8ee35 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60672024-08-30T19:51:03.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4c4367bd-5eb4-4a4b-8e32-60b8ded8ee35 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60682024-08-30T19:51:04.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f1cf4bb8-ec97-47ca-bb30-39b2dbe4397a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60692024-08-30T19:51:04.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f1cf4bb8-ec97-47ca-bb30-39b2dbe4397a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60702024-08-30T19:51:04.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f1cf4bb8-ec97-47ca-bb30-39b2dbe4397a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60712024-08-30T19:51:05.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cad463a7-def6-4b01-bbd4-0efab172419e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60722024-08-30T19:51:05.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cad463a7-def6-4b01-bbd4-0efab172419e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60732024-08-30T19:51:05.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cad463a7-def6-4b01-bbd4-0efab172419e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60742024-08-30T19:51:07.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 363fa835-dd2d-4f93-9e0b-597665998f1f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60752024-08-30T19:51:07.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 363fa835-dd2d-4f93-9e0b-597665998f1f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60762024-08-30T19:51:07.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 363fa835-dd2d-4f93-9e0b-597665998f1f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60772024-08-30T19:51:08.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a165cb8e-7279-41ed-b752-e50564dadbb8 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60782024-08-30T19:51:08.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a165cb8e-7279-41ed-b752-e50564dadbb8 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60792024-08-30T19:51:08.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a165cb8e-7279-41ed-b752-e50564dadbb8 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60802024-08-30T19:51:09.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6124c1c2-f7c8-4768-95d2-2286afa4abd9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60812024-08-30T19:51:09.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6124c1c2-f7c8-4768-95d2-2286afa4abd9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60822024-08-30T19:51:09.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 6124c1c2-f7c8-4768-95d2-2286afa4abd9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60832024-08-30T19:51:10.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 439f7363-e998-45b4-87dc-670a6b60cc76 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60842024-08-30T19:51:10.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 439f7363-e998-45b4-87dc-670a6b60cc76 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60852024-08-30T19:51:10.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 439f7363-e998-45b4-87dc-670a6b60cc76 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60862024-08-30T19:51:10.277ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 54010f2b-32da-4675-a393-549ce1a2305b response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
60872024-08-30T19:51:11.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad26b435-5891-451a-a35f-9225c2e78fa3 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60882024-08-30T19:51:11.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad26b435-5891-451a-a35f-9225c2e78fa3 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60892024-08-30T19:51:11.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ad26b435-5891-451a-a35f-9225c2e78fa3 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
60902024-08-30T19:51:11.774ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
60912024-08-30T19:51:11.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
60922024-08-30T19:51:11.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60932024-08-30T19:51:11.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60942024-08-30T19:51:11.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60952024-08-30T19:51:11.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60962024-08-30T19:51:11.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60972024-08-30T19:51:11.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982024-08-30T19:51:11.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60992024-08-30T19:51:11.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.228457ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61002024-08-30T19:51:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61012024-08-30T19:51:11.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61022024-08-30T19:51:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61032024-08-30T19:51:11.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61042024-08-30T19:51:11.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61052024-08-30T19:51:11.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61062024-08-30T19:51:11.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
61072024-08-30T19:51:11.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61082024-08-30T19:51:11.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61092024-08-30T19:51:11.792ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
61102024-08-30T19:51:11.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.200059ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
61112024-08-30T19:51:12.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf2e282f-2585-409d-a6fd-1a320f1a9d70 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61122024-08-30T19:51:12.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf2e282f-2585-409d-a6fd-1a320f1a9d70 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61132024-08-30T19:51:12.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = bf2e282f-2585-409d-a6fd-1a320f1a9d70 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61142024-08-30T19:51:13.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 09596456-3d9a-4ec5-b4d4-6ae9b253157f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61152024-08-30T19:51:13.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 09596456-3d9a-4ec5-b4d4-6ae9b253157f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61162024-08-30T19:51:13.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 09596456-3d9a-4ec5-b4d4-6ae9b253157f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61172024-08-30T19:51:14.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = ea22ac66-9e81-4318-a56a-2e8e95a79402 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
61182024-08-30T19:51:14.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = ea22ac66-9e81-4318-a56a-2e8e95a79402 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
61192024-08-30T19:51:14.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = ea22ac66-9e81-4318-a56a-2e8e95a79402 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
61202024-08-30T19:51:14.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 95a683c4-e121-4886-922f-87b6b0d072c9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61212024-08-30T19:51:14.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 95a683c4-e121-4886-922f-87b6b0d072c9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61222024-08-30T19:51:14.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 95a683c4-e121-4886-922f-87b6b0d072c9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61232024-08-30T19:51:14.630ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60244
61242024-08-30T19:51:14.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60244 req_id = 780103db-329d-4730-8fcc-346fc6029e51 roles = RoleSet { roles: {} } uri = /metrics/producers
61252024-08-30T19:51:14.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60244 req_id = 780103db-329d-4730-8fcc-346fc6029e51 resource = Database result = Ok(()) uri = /metrics/producers
61262024-08-30T19:51:14.663ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 391744bd-9064-4e92-ab26-8edda407dd8c
61272024-08-30T19:51:14.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60244 req_id = 780103db-329d-4730-8fcc-346fc6029e51 roles = RoleSet { roles: {} } uri = /metrics/producers
61282024-08-30T19:51:14.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60244 req_id = 780103db-329d-4730-8fcc-346fc6029e51 resource = Database result = Ok(()) uri = /metrics/producers
61292024-08-30T19:51:14.669ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c uri = http://[fd00:1122:3344:101::d]:12223/producers
61302024-08-30T19:51:14.669ZDEBGnexus: client response oximeter-collector = 391744bd-9064-4e92-ab26-8edda407dd8c result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ecccfaf9-919c-4753-b247-eea8372df86f", "date": "Fri, 30 Aug 2024 19:51:14 GMT"} })
61312024-08-30T19:51:14.669ZINFOnexus: assigned collector to new producer collector_id = 391744bd-9064-4e92-ab26-8edda407dd8c file = nexus/src/app/oximeter.rs:125 producer_id = e392e9bc-bfce-46aa-93ab-b26313dd4677
61322024-08-30T19:51:14.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41670 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60244 req_id = 780103db-329d-4730-8fcc-346fc6029e51 response_code = 201 uri = /metrics/producers
61332024-08-30T19:51:15.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 33901afa-655b-4c20-89f6-7125bc5ddb34 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61342024-08-30T19:51:15.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 33901afa-655b-4c20-89f6-7125bc5ddb34 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61352024-08-30T19:51:15.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 33901afa-655b-4c20-89f6-7125bc5ddb34 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61362024-08-30T19:51:16.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d6451001-6f84-4635-bf32-6ce72c37a37b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61372024-08-30T19:51:16.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d6451001-6f84-4635-bf32-6ce72c37a37b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61382024-08-30T19:51:16.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = d6451001-6f84-4635-bf32-6ce72c37a37b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61392024-08-30T19:51:17.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = af35a7c8-5d03-4c8d-9900-b02ed216e010 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61402024-08-30T19:51:17.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = af35a7c8-5d03-4c8d-9900-b02ed216e010 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61412024-08-30T19:51:17.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = af35a7c8-5d03-4c8d-9900-b02ed216e010 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61422024-08-30T19:51:18.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3f37467a-267f-4a64-8e06-cbd65f3f3954 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61432024-08-30T19:51:18.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3f37467a-267f-4a64-8e06-cbd65f3f3954 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61442024-08-30T19:51:18.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3f37467a-267f-4a64-8e06-cbd65f3f3954 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61452024-08-30T19:51:19.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4f36614a-2633-4348-8171-a05c0fedcf64 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61462024-08-30T19:51:19.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4f36614a-2633-4348-8171-a05c0fedcf64 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61472024-08-30T19:51:19.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4f36614a-2633-4348-8171-a05c0fedcf64 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61482024-08-30T19:51:20.277ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1639 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = e6c4200f-2610-4dc6-ab3d-2f15e400767a response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
61492024-08-30T19:51:20.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4fae4ef5-dbb1-4ec3-ad07-bd5cd6f732f4 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61502024-08-30T19:51:20.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4fae4ef5-dbb1-4ec3-ad07-bd5cd6f732f4 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61512024-08-30T19:51:20.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4fae4ef5-dbb1-4ec3-ad07-bd5cd6f732f4 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61522024-08-30T19:51:21.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec0fbfac-1200-4c92-bcd8-1cccfbf78a89 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61532024-08-30T19:51:21.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec0fbfac-1200-4c92-bcd8-1cccfbf78a89 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61542024-08-30T19:51:21.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ec0fbfac-1200-4c92-bcd8-1cccfbf78a89 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61552024-08-30T19:51:21.774ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
61562024-08-30T19:51:21.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
61572024-08-30T19:51:21.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61582024-08-30T19:51:21.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61592024-08-30T19:51:21.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61602024-08-30T19:51:21.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61612024-08-30T19:51:21.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61622024-08-30T19:51:21.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61632024-08-30T19:51:21.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61642024-08-30T19:51:21.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.769836ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61652024-08-30T19:51:21.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61662024-08-30T19:51:21.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61672024-08-30T19:51:21.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61682024-08-30T19:51:21.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61692024-08-30T19:51:21.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61702024-08-30T19:51:21.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61712024-08-30T19:51:21.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
61722024-08-30T19:51:21.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61732024-08-30T19:51:21.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61742024-08-30T19:51:21.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
61752024-08-30T19:51:21.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.699433ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
61762024-08-30T19:51:22.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0956c248-bfc6-4029-8c1e-edc06c3ddba1 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61772024-08-30T19:51:22.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0956c248-bfc6-4029-8c1e-edc06c3ddba1 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61782024-08-30T19:51:22.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 0956c248-bfc6-4029-8c1e-edc06c3ddba1 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61792024-08-30T19:51:23.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1eb9fcb5-3c96-4299-a22b-21ff98907927 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61802024-08-30T19:51:23.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1eb9fcb5-3c96-4299-a22b-21ff98907927 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61812024-08-30T19:51:23.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1eb9fcb5-3c96-4299-a22b-21ff98907927 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61822024-08-30T19:51:24.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17a8e156-a68b-47a2-bc66-f4607401ca29 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61832024-08-30T19:51:24.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17a8e156-a68b-47a2-bc66-f4607401ca29 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61842024-08-30T19:51:24.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 17a8e156-a68b-47a2-bc66-f4607401ca29 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61852024-08-30T19:51:25.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c906a675-06a2-4697-9ab2-bab25dc3b45e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61862024-08-30T19:51:25.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c906a675-06a2-4697-9ab2-bab25dc3b45e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61872024-08-30T19:51:25.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c906a675-06a2-4697-9ab2-bab25dc3b45e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61882024-08-30T19:51:26.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f37f03ed-d44b-4c4a-87c7-9dd58907e704 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61892024-08-30T19:51:26.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f37f03ed-d44b-4c4a-87c7-9dd58907e704 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61902024-08-30T19:51:26.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f37f03ed-d44b-4c4a-87c7-9dd58907e704 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61912024-08-30T19:51:27.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7aff52f9-7b76-41b9-a638-04555d1919f7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61922024-08-30T19:51:27.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7aff52f9-7b76-41b9-a638-04555d1919f7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61932024-08-30T19:51:27.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7aff52f9-7b76-41b9-a638-04555d1919f7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61942024-08-30T19:51:28.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ea0a2525-55cc-40f9-bf0f-75f4e62ebf8a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61952024-08-30T19:51:28.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ea0a2525-55cc-40f9-bf0f-75f4e62ebf8a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61962024-08-30T19:51:28.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ea0a2525-55cc-40f9-bf0f-75f4e62ebf8a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61972024-08-30T19:51:29.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4a7a5935-9f3b-495a-9722-921e5606890f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61982024-08-30T19:51:29.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4a7a5935-9f3b-495a-9722-921e5606890f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
61992024-08-30T19:51:29.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4a7a5935-9f3b-495a-9722-921e5606890f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
62002024-08-30T19:51:30.278ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 37e0bb63-317d-4c1e-b256-b089978e274f response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
62012024-08-30T19:51:30.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7309b683-fc77-4e6d-92a1-fc738c6f478a roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
62022024-08-30T19:51:30.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7309b683-fc77-4e6d-92a1-fc738c6f478a resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
62032024-08-30T19:51:30.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7309b683-fc77-4e6d-92a1-fc738c6f478a response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
62042024-08-30T19:51:31.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8340cdc6-28e2-4c13-82bb-b0f43d5ad04c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
62052024-08-30T19:51:31.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8340cdc6-28e2-4c13-82bb-b0f43d5ad04c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
62062024-08-30T19:51:31.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 8340cdc6-28e2-4c13-82bb-b0f43d5ad04c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
62072024-08-30T19:51:31.773ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
62082024-08-30T19:51:31.773ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62092024-08-30T19:51:31.773ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
62102024-08-30T19:51:31.773ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
62112024-08-30T19:51:31.773ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62122024-08-30T19:51:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62132024-08-30T19:51:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62142024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
62152024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
62162024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62172024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62182024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
62192024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62202024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62212024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
62222024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
62232024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62242024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62252024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
62262024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
62272024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62282024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
62292024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62302024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
62312024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62322024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62332024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
62342024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62352024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
62362024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
62372024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62382024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62392024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
62402024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62412024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
62422024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62432024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62442024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62452024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62462024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62472024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62482024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62492024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62502024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62512024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62522024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62532024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62542024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62552024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62562024-08-30T19:51:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62572024-08-30T19:51:31.776ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.41774ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62582024-08-30T19:51:31.776ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 79842233 } })
62592024-08-30T19:51:31.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.347252ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
62602024-08-30T19:51:31.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62612024-08-30T19:51:31.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.319858ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
62622024-08-30T19:51:31.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
62632024-08-30T19:51:31.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 81076815 } })
62642024-08-30T19:51:31.778ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
62652024-08-30T19:51:31.779ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62662024-08-30T19:51:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62672024-08-30T19:51:31.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62682024-08-30T19:51:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62692024-08-30T19:51:31.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62702024-08-30T19:51:31.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62712024-08-30T19:51:31.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62722024-08-30T19:51:31.782ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62732024-08-30T19:51:31.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62742024-08-30T19:51:31.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62752024-08-30T19:51:31.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62762024-08-30T19:51:31.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62772024-08-30T19:51:31.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62782024-08-30T19:51:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62792024-08-30T19:51:31.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62802024-08-30T19:51:31.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62812024-08-30T19:51:31.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62822024-08-30T19:51:31.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62832024-08-30T19:51:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62842024-08-30T19:51:31.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62852024-08-30T19:51:31.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62862024-08-30T19:51:31.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62872024-08-30T19:51:31.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62882024-08-30T19:51:31.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62892024-08-30T19:51:31.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62902024-08-30T19:51:31.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62912024-08-30T19:51:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62922024-08-30T19:51:31.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62932024-08-30T19:51:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62942024-08-30T19:51:31.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62952024-08-30T19:51:31.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62962024-08-30T19:51:31.824ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
62972024-08-30T19:51:31.824ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62982024-08-30T19:51:31.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62992024-08-30T19:51:31.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63002024-08-30T19:51:31.824ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63012024-08-30T19:51:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63022024-08-30T19:51:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63032024-08-30T19:51:31.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63042024-08-30T19:51:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63052024-08-30T19:51:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 289c9d10-fa69-4638-aac7-3cfc6b4e23be, lookup_type: ById(289c9d10-fa69-4638-aac7-3cfc6b4e23be) } result = Ok(())
63062024-08-30T19:51:31.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63072024-08-30T19:51:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63082024-08-30T19:51:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
63092024-08-30T19:51:31.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63102024-08-30T19:51:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63112024-08-30T19:51:31.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63122024-08-30T19:51:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63132024-08-30T19:51:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63142024-08-30T19:51:31.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63152024-08-30T19:51:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63162024-08-30T19:51:31.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.388132ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
63172024-08-30T19:51:31.831ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.093632ms iteration = 18 status = 0
63182024-08-30T19:51:31.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.761923ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63192024-08-30T19:51:31.836ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63202024-08-30T19:51:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63212024-08-30T19:51:31.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63222024-08-30T19:51:31.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
63232024-08-30T19:51:31.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.457998ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
63242024-08-30T19:51:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63252024-08-30T19:51:31.840ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-289c9d10-fa69-4638-aac7-3cfc6b4e23be.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 143621572 } })
63262024-08-30T19:51:31.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63272024-08-30T19:51:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63282024-08-30T19:51:31.840ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
63292024-08-30T19:51:31.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63302024-08-30T19:51:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63312024-08-30T19:51:31.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63322024-08-30T19:51:31.847ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63332024-08-30T19:51:31.847ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63342024-08-30T19:51:31.847ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ff479bf-ac06-4027-97c5-82904bc755d5", "content-length": "26", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
63352024-08-30T19:51:31.847ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63362024-08-30T19:51:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63372024-08-30T19:51:31.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63382024-08-30T19:51:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63392024-08-30T19:51:31.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63402024-08-30T19:51:31.860ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63412024-08-30T19:51:31.860ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63422024-08-30T19:51:31.860ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.901798ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
63432024-08-30T19:51:31.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63442024-08-30T19:51:31.864ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63452024-08-30T19:51:31.865ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "40662be0-ca98-4cbe-9b08-6091efd4fd6b", "content-length": "26", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
63462024-08-30T19:51:31.865ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63472024-08-30T19:51:31.866ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63482024-08-30T19:51:31.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.621793ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63492024-08-30T19:51:31.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63502024-08-30T19:51:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63512024-08-30T19:51:31.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63522024-08-30T19:51:31.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.211321ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63532024-08-30T19:51:31.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63542024-08-30T19:51:31.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63552024-08-30T19:51:31.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.633195ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63562024-08-30T19:51:31.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63572024-08-30T19:51:31.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63582024-08-30T19:51:31.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63592024-08-30T19:51:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63602024-08-30T19:51:31.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63612024-08-30T19:51:31.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63622024-08-30T19:51:31.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63632024-08-30T19:51:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63642024-08-30T19:51:31.934ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.016258ms iteration = 21 status = {"physical_disks_added":0}
63652024-08-30T19:51:31.975ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63662024-08-30T19:51:31.975ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c0d3eb3a-ba43-41e4-8f98-f760f266405e", "content-length": "2", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
63672024-08-30T19:51:31.977ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63682024-08-30T19:51:31.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63692024-08-30T19:51:32.000ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 227.530462ms iteration = 18 status = {}
63702024-08-30T19:51:32.030ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63712024-08-30T19:51:32.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e zone_address = fd00:1122:3344:101::2
63722024-08-30T19:51:32.036ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63732024-08-30T19:51:32.037ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54ea0d9e-91fe-4dbb-b49e-114c841b1723", "content-length": "26", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
63742024-08-30T19:51:32.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63752024-08-30T19:51:32.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
63762024-08-30T19:51:32.047ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63772024-08-30T19:51:32.049ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 276.668774ms iteration = 18 status = null
63782024-08-30T19:51:32.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e6510ec-420a-4d00-bbf3-0fade0af5e78", "content-length": "372", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
63792024-08-30T19:51:32.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63802024-08-30T19:51:32.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "79a15c66-dec9-4fee-a741-b04fc688a5e2", "content-length": "691", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
63812024-08-30T19:51:32.075ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63822024-08-30T19:51:32.075ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63832024-08-30T19:51:32.075ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63842024-08-30T19:51:32.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63852024-08-30T19:51:32.076ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 302.331885ms iteration = 19 status = {}
63862024-08-30T19:51:32.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63872024-08-30T19:51:32.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63882024-08-30T19:51:32.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63892024-08-30T19:51:32.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63902024-08-30T19:51:32.084ZDEBGnexus (BackgroundTasks): client request SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63912024-08-30T19:51:32.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 289c9d10-fa69-4638-aac7-3cfc6b4e23be background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a59908ea-2e17-4410-a4aa-cc566b1ac544", "date": "Fri, 30 Aug 2024 19:51:32 GMT"} })
63922024-08-30T19:51:32.087ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 312.677136ms iteration = 20 status = {}
63932024-08-30T19:51:32.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63942024-08-30T19:51:32.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63952024-08-30T19:51:32.133ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 7ccb4afc-fc07-48c6-8785-c2cff1ca389e, rack_id: 27cfef72-d05b-490f-ac92-5c7cad830c2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(49669c7e-dd3c-47ce-aadc-885f0c38581f) } rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
63962024-08-30T19:51:32.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63972024-08-30T19:51:32.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63982024-08-30T19:51:32.141ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63992024-08-30T19:51:32.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd2a034-1bf4-4009-bddc-7c077b51471d", "content-length": "121", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
64002024-08-30T19:51:32.142ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
64012024-08-30T19:51:32.142ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 49669c7e-dd3c-47ce-aadc-885f0c38581f
64022024-08-30T19:51:32.142ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64032024-08-30T19:51:32.142ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64042024-08-30T19:51:32.142ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
64052024-08-30T19:51:32.142ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e routes = {}
64062024-08-30T19:51:32.142ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e
64072024-08-30T19:51:32.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64082024-08-30T19:51:32.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64092024-08-30T19:51:32.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64102024-08-30T19:51:32.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2917f61f-14fe-43a5-9224-f55ef7bcf91d", "content-length": "2", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
64112024-08-30T19:51:32.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64122024-08-30T19:51:32.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a7b914ec-093c-499b-bba7-4e827aaf914b", "content-length": "52", "date": "Fri, 30 Aug 2024 19:51:31 GMT"} })
64132024-08-30T19:51:32.144ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch_location = Switch0
64142024-08-30T19:51:32.144ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64152024-08-30T19:51:32.232ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b323fc4f-b1d8-451e-bb7e-58466ab99324", "date": "Fri, 30 Aug 2024 19:51:32 GMT"} })
64162024-08-30T19:51:32.232ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e switch = Switch0
64172024-08-30T19:51:32.232ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64182024-08-30T19:51:32.233ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 27cfef72-d05b-490f-ac92-5c7cad830c2e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e77cbfb1-a089-424d-9494-a44aedfc9fef", "content-length": "667", "date": "Fri, 30 Aug 2024 19:51:32 GMT"} })
64192024-08-30T19:51:32.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64202024-08-30T19:51:32.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64212024-08-30T19:51:32.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64222024-08-30T19:51:32.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64232024-08-30T19:51:32.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64242024-08-30T19:51:32.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64252024-08-30T19:51:32.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64262024-08-30T19:51:32.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64272024-08-30T19:51:32.248ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 474.079149ms iteration = 18 status = {}
64282024-08-30T19:51:32.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e01a6a8-d0d1-43b4-a74c-da622ea0351f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64292024-08-30T19:51:32.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e01a6a8-d0d1-43b4-a74c-da622ea0351f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64302024-08-30T19:51:32.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 4e01a6a8-d0d1-43b4-a74c-da622ea0351f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64312024-08-30T19:51:33.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 31ef5caf-b09a-4b07-8742-343cced8edbf roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64322024-08-30T19:51:33.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 31ef5caf-b09a-4b07-8742-343cced8edbf resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64332024-08-30T19:51:33.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 31ef5caf-b09a-4b07-8742-343cced8edbf response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64342024-08-30T19:51:34.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a19a46a4-471b-4150-9d99-f6cf0af8b9ac roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64352024-08-30T19:51:34.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a19a46a4-471b-4150-9d99-f6cf0af8b9ac resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64362024-08-30T19:51:34.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a19a46a4-471b-4150-9d99-f6cf0af8b9ac response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64372024-08-30T19:51:35.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ced3b6ab-dab2-497b-aa55-3a4268df80f7 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64382024-08-30T19:51:35.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ced3b6ab-dab2-497b-aa55-3a4268df80f7 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64392024-08-30T19:51:35.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ced3b6ab-dab2-497b-aa55-3a4268df80f7 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64402024-08-30T19:51:36.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3668deed-4dda-42c0-8419-9a4100bf987e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64412024-08-30T19:51:36.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3668deed-4dda-42c0-8419-9a4100bf987e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64422024-08-30T19:51:36.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3668deed-4dda-42c0-8419-9a4100bf987e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64432024-08-30T19:51:37.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e7c3a54-6bda-4ebc-91d8-a2fd42a272df roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64442024-08-30T19:51:37.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e7c3a54-6bda-4ebc-91d8-a2fd42a272df resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64452024-08-30T19:51:37.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2e7c3a54-6bda-4ebc-91d8-a2fd42a272df response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64462024-08-30T19:51:38.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5fd568bd-4e8b-4836-b0d1-e95fae9c8916 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64472024-08-30T19:51:38.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5fd568bd-4e8b-4836-b0d1-e95fae9c8916 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64482024-08-30T19:51:38.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 5fd568bd-4e8b-4836-b0d1-e95fae9c8916 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64492024-08-30T19:51:39.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 061833aa-054b-4a70-bc2c-d00d7fb3ccd9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64502024-08-30T19:51:39.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 061833aa-054b-4a70-bc2c-d00d7fb3ccd9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64512024-08-30T19:51:39.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 061833aa-054b-4a70-bc2c-d00d7fb3ccd9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64522024-08-30T19:51:40.277ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = 52e34164-c9e0-4ab3-b80c-4c34eeeaaa04 response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
64532024-08-30T19:51:40.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f3497298-8145-447a-9427-1fd900e7fafa roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64542024-08-30T19:51:40.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f3497298-8145-447a-9427-1fd900e7fafa resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64552024-08-30T19:51:40.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = f3497298-8145-447a-9427-1fd900e7fafa response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64562024-08-30T19:51:41.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1c51e31f-cd3f-49f7-b0bf-16106a00409f roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64572024-08-30T19:51:41.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1c51e31f-cd3f-49f7-b0bf-16106a00409f resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64582024-08-30T19:51:41.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 1c51e31f-cd3f-49f7-b0bf-16106a00409f response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64592024-08-30T19:51:41.774ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
64602024-08-30T19:51:41.774ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
64612024-08-30T19:51:41.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64622024-08-30T19:51:41.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64632024-08-30T19:51:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64642024-08-30T19:51:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64652024-08-30T19:51:41.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64662024-08-30T19:51:41.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64672024-08-30T19:51:41.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64682024-08-30T19:51:41.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64692024-08-30T19:51:41.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64702024-08-30T19:51:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64712024-08-30T19:51:41.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64722024-08-30T19:51:41.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64732024-08-30T19:51:41.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64742024-08-30T19:51:41.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
64752024-08-30T19:51:41.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64762024-08-30T19:51:41.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64772024-08-30T19:51:41.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
64782024-08-30T19:51:41.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.00407ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
64792024-08-30T19:51:41.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.329023ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64802024-08-30T19:51:42.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7e72ceb7-d232-40c3-be6f-6b43be780e5c roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64812024-08-30T19:51:42.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7e72ceb7-d232-40c3-be6f-6b43be780e5c resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64822024-08-30T19:51:42.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 7e72ceb7-d232-40c3-be6f-6b43be780e5c response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64832024-08-30T19:51:43.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a560e5a9-2261-4a44-8c8f-e6a5b6e51184 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64842024-08-30T19:51:43.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a560e5a9-2261-4a44-8c8f-e6a5b6e51184 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64852024-08-30T19:51:43.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a560e5a9-2261-4a44-8c8f-e6a5b6e51184 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64862024-08-30T19:51:44.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 055ab2f2-1f61-46b7-b922-963a4f35d24a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
64872024-08-30T19:51:44.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 055ab2f2-1f61-46b7-b922-963a4f35d24a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
64882024-08-30T19:51:44.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62994 req_id = 055ab2f2-1f61-46b7-b922-963a4f35d24a response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
64892024-08-30T19:51:44.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b8bc9586-ecb2-43b6-ac58-d25b676828a9 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64902024-08-30T19:51:44.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b8bc9586-ecb2-43b6-ac58-d25b676828a9 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64912024-08-30T19:51:44.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b8bc9586-ecb2-43b6-ac58-d25b676828a9 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64922024-08-30T19:51:45.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2be4f7b6-5db0-4e25-bc79-88becb1f8527 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64932024-08-30T19:51:45.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2be4f7b6-5db0-4e25-bc79-88becb1f8527 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64942024-08-30T19:51:45.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 2be4f7b6-5db0-4e25-bc79-88becb1f8527 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64952024-08-30T19:51:46.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = abf4a99f-675b-4a34-af51-fa0e441f2daf roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64962024-08-30T19:51:46.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = abf4a99f-675b-4a34-af51-fa0e441f2daf resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64972024-08-30T19:51:46.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = abf4a99f-675b-4a34-af51-fa0e441f2daf response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64982024-08-30T19:51:47.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23350cd4-b9ed-476e-87b5-c8f5fc3d3b0b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
64992024-08-30T19:51:47.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23350cd4-b9ed-476e-87b5-c8f5fc3d3b0b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65002024-08-30T19:51:47.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 23350cd4-b9ed-476e-87b5-c8f5fc3d3b0b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65012024-08-30T19:51:48.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3c49e043-c692-483a-87cb-d965740efd3d roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65022024-08-30T19:51:48.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3c49e043-c692-483a-87cb-d965740efd3d resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65032024-08-30T19:51:48.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 3c49e043-c692-483a-87cb-d965740efd3d response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65042024-08-30T19:51:49.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cb9a4421-8c72-4f9b-8f4e-26521f962137 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65052024-08-30T19:51:49.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cb9a4421-8c72-4f9b-8f4e-26521f962137 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65062024-08-30T19:51:49.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = cb9a4421-8c72-4f9b-8f4e-26521f962137 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65072024-08-30T19:51:50.277ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:38415 method = GET remote_addr = [fd00:1122:3344:101::d]:42154 req_id = d95b8386-5525-43ca-991b-b62dcd7df52b response_code = 200 uri = /1d96d476-acdb-4c44-a486-29569b3bf41e
65082024-08-30T19:51:50.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 26f30349-647d-4959-9e5a-5b18341936bd roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65092024-08-30T19:51:50.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 26f30349-647d-4959-9e5a-5b18341936bd resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65102024-08-30T19:51:50.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 26f30349-647d-4959-9e5a-5b18341936bd response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65112024-08-30T19:51:51.775ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
65122024-08-30T19:51:51.775ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
65132024-08-30T19:51:51.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65142024-08-30T19:51:51.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65152024-08-30T19:51:51.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65162024-08-30T19:51:51.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65172024-08-30T19:51:51.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65182024-08-30T19:51:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65192024-08-30T19:51:51.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65202024-08-30T19:51:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65212024-08-30T19:51:51.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65222024-08-30T19:51:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65232024-08-30T19:51:51.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65242024-08-30T19:51:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6cec0807-9a99-4265-913f-3aea7fdc6b25, lookup_type: ById(6cec0807-9a99-4265-913f-3aea7fdc6b25) } result = Ok(())
65252024-08-30T19:51:51.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65262024-08-30T19:51:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65272024-08-30T19:51:51.793ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 original_time_created = 2024-08-30 19:42:44.596991 UTC target_id = 6cec0807-9a99-4265-913f-3aea7fdc6b25 time_created = 2024-08-30 19:42:44.596991 UTC
65282024-08-30T19:51:51.793ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.484774ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6cec0807-9a99-4265-913f-3aea7fdc6b25","time_created":"2024-08-30T19:42:44.596991Z"}
65292024-08-30T19:51:51.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65302024-08-30T19:51:51.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65312024-08-30T19:51:51.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.092458ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65322024-08-30T19:51:51.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b5778865-fb1b-469e-86ac-281b11f2c6b2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65332024-08-30T19:51:51.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b5778865-fb1b-469e-86ac-281b11f2c6b2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65342024-08-30T19:51:51.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = b5778865-fb1b-469e-86ac-281b11f2c6b2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65352024-08-30T19:51:52.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = de3239ee-1fb9-498c-a6ac-209d4f82041b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65362024-08-30T19:51:52.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = de3239ee-1fb9-498c-a6ac-209d4f82041b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65372024-08-30T19:51:52.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = de3239ee-1fb9-498c-a6ac-209d4f82041b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65382024-08-30T19:51:54.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a02f156d-90ea-41b8-94d8-cb7413ab7e00 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65392024-08-30T19:51:54.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a02f156d-90ea-41b8-94d8-cb7413ab7e00 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65402024-08-30T19:51:54.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = a02f156d-90ea-41b8-94d8-cb7413ab7e00 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65412024-08-30T19:51:55.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c5742a62-88e1-4b75-99b4-7c51c3f85bd2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65422024-08-30T19:51:55.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c5742a62-88e1-4b75-99b4-7c51c3f85bd2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65432024-08-30T19:51:55.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = c5742a62-88e1-4b75-99b4-7c51c3f85bd2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65442024-08-30T19:51:56.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae69864b-c3d6-470d-a6be-e5a8b061fa0b roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65452024-08-30T19:51:56.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae69864b-c3d6-470d-a6be-e5a8b061fa0b resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65462024-08-30T19:51:56.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = ae69864b-c3d6-470d-a6be-e5a8b061fa0b response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65472024-08-30T19:51:57.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 56f82c75-ae51-4958-ae76-f8ab01ecac5e roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65482024-08-30T19:51:57.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 56f82c75-ae51-4958-ae76-f8ab01ecac5e resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65492024-08-30T19:51:57.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = 56f82c75-ae51-4958-ae76-f8ab01ecac5e response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65502024-08-30T19:51:58.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e887cead-428a-4d1e-8940-c4998769dce2 roles = RoleSet { roles: {} } uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65512024-08-30T19:51:58.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e887cead-428a-4d1e-8940-c4998769dce2 resource = Database result = Ok(()) uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be
65522024-08-30T19:51:58.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63426 req_id = e887cead-428a-4d1e-8940-c4998769dce2 response_code = 200 uri = /probes/289c9d10-fa69-4638-aac7-3cfc6b4e23be