Max level shown:
12024-09-10T21:30:02.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1be6d952-6f87-4a97-8661-6333f08bf5e3 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
22024-09-10T21:30:02.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1be6d952-6f87-4a97-8661-6333f08bf5e3 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
32024-09-10T21:30:02.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1be6d952-6f87-4a97-8661-6333f08bf5e3 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
42024-09-10T21:30:03.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1a234e0f-d4b0-4cca-8544-6abd78766e5e roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
52024-09-10T21:30:03.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1a234e0f-d4b0-4cca-8544-6abd78766e5e resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
62024-09-10T21:30:03.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1a234e0f-d4b0-4cca-8544-6abd78766e5e response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
72024-09-10T21:30:04.033ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62031
82024-09-10T21:30:04.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62031 req_id = 778fa004-ad51-4629-b345-20a9996ef711 roles = RoleSet { roles: {} } uri = /metrics/producers
92024-09-10T21:30:04.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62031 req_id = 778fa004-ad51-4629-b345-20a9996ef711 resource = Database result = Ok(()) uri = /metrics/producers
102024-09-10T21:30:04.083ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
112024-09-10T21:30:04.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62031 req_id = 778fa004-ad51-4629-b345-20a9996ef711 roles = RoleSet { roles: {} } uri = /metrics/producers
122024-09-10T21:30:04.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62031 req_id = 778fa004-ad51-4629-b345-20a9996ef711 resource = Database result = Ok(()) uri = /metrics/producers
132024-09-10T21:30:04.125ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
142024-09-10T21:30:04.125ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b607e099-e869-41cf-945a-4187a35a63e4", "date": "Tue, 10 Sep 2024 21:30:04 GMT"} })
152024-09-10T21:30:04.125ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 05f422ab-efd1-4f45-9453-f93ccaaaff0f
162024-09-10T21:30:04.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94958 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62031 req_id = 778fa004-ad51-4629-b345-20a9996ef711 response_code = 201 uri = /metrics/producers
172024-09-10T21:30:04.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4083bdd1-79d5-433b-97fa-0112e3a87bd8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
182024-09-10T21:30:04.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4083bdd1-79d5-433b-97fa-0112e3a87bd8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
192024-09-10T21:30:04.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4083bdd1-79d5-433b-97fa-0112e3a87bd8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
202024-09-10T21:30:05.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 01e160f7-83b3-48c1-84c4-466d8ad16da0 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
212024-09-10T21:30:05.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 01e160f7-83b3-48c1-84c4-466d8ad16da0 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
222024-09-10T21:30:05.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 01e160f7-83b3-48c1-84c4-466d8ad16da0 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
232024-09-10T21:30:05.763ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
242024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
252024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
262024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
272024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
282024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
292024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
302024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
322024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
332024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
342024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
352024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
362024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
372024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
382024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
392024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
402024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
412024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
422024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
432024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
452024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
462024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
472024-09-10T21:30:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
482024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
492024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
502024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
512024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
522024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
532024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
542024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
552024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
562024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
572024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
582024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
592024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
602024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
612024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
622024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
632024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
642024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
652024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
662024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
672024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
682024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
692024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
702024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
712024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
722024-09-10T21:30:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
732024-09-10T21:30:05.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
742024-09-10T21:30:05.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
752024-09-10T21:30:05.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2757, tv_nsec: 285860215 } })
762024-09-10T21:30:05.768ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.517439ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
772024-09-10T21:30:05.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
782024-09-10T21:30:05.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
792024-09-10T21:30:05.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
802024-09-10T21:30:05.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
812024-09-10T21:30:05.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
822024-09-10T21:30:05.770ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2757, tv_nsec: 288287668 } })
832024-09-10T21:30:05.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
842024-09-10T21:30:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
852024-09-10T21:30:05.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
862024-09-10T21:30:05.771ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
872024-09-10T21:30:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
882024-09-10T21:30:05.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
892024-09-10T21:30:05.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
902024-09-10T21:30:05.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
912024-09-10T21:30:05.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
922024-09-10T21:30:05.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
932024-09-10T21:30:05.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.829554ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
942024-09-10T21:30:05.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
952024-09-10T21:30:05.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
962024-09-10T21:30:05.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
972024-09-10T21:30:05.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
982024-09-10T21:30:05.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
992024-09-10T21:30:05.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1002024-09-10T21:30:05.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1012024-09-10T21:30:05.778ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2757, tv_nsec: 296078514 } })
1022024-09-10T21:30:05.778ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
1032024-09-10T21:30:05.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1042024-09-10T21:30:05.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1052024-09-10T21:30:05.780ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1062024-09-10T21:30:05.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1072024-09-10T21:30:05.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1082024-09-10T21:30:05.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1092024-09-10T21:30:05.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1102024-09-10T21:30:05.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1112024-09-10T21:30:05.784ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1122024-09-10T21:30:05.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1132024-09-10T21:30:05.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.68112ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
1142024-09-10T21:30:05.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1152024-09-10T21:30:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1162024-09-10T21:30:05.812ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1172024-09-10T21:30:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1182024-09-10T21:30:05.813ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1192024-09-10T21:30:05.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1202024-09-10T21:30:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1212024-09-10T21:30:05.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1222024-09-10T21:30:05.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1232024-09-10T21:30:05.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1242024-09-10T21:30:05.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1252024-09-10T21:30:05.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1262024-09-10T21:30:05.817ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
1272024-09-10T21:30:05.817ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1282024-09-10T21:30:05.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1292024-09-10T21:30:05.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1302024-09-10T21:30:05.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1312024-09-10T21:30:05.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1322024-09-10T21:30:05.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1332024-09-10T21:30:05.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1342024-09-10T21:30:05.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1352024-09-10T21:30:05.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1362024-09-10T21:30:05.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1372024-09-10T21:30:05.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1382024-09-10T21:30:05.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1392024-09-10T21:30:05.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
1402024-09-10T21:30:05.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1412024-09-10T21:30:05.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1422024-09-10T21:30:05.823ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1432024-09-10T21:30:05.823ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.320838ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1442024-09-10T21:30:05.833ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
1452024-09-10T21:30:05.833ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.318449ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
1462024-09-10T21:30:05.839ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
1472024-09-10T21:30:05.839ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1482024-09-10T21:30:05.840ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c84bf694-0247-4f41-be04-628b7eb5c397", "content-length": "26", "date": "Tue, 10 Sep 2024 21:30:05 GMT"} })
1492024-09-10T21:30:05.840ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1502024-09-10T21:30:05.841ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1512024-09-10T21:30:05.843ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
1522024-09-10T21:30:05.843ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1532024-09-10T21:30:05.844ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91e54418-7382-4adb-87a3-ec60847cf993", "content-length": "26", "date": "Tue, 10 Sep 2024 21:30:05 GMT"} })
1542024-09-10T21:30:05.844ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1552024-09-10T21:30:05.847ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1562024-09-10T21:30:05.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.96002ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1572024-09-10T21:30:05.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.192251ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
1582024-09-10T21:30:05.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1592024-09-10T21:30:05.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1602024-09-10T21:30:05.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.586469ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1612024-09-10T21:30:05.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1622024-09-10T21:30:05.853ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
1632024-09-10T21:30:05.853ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1642024-09-10T21:30:05.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1652024-09-10T21:30:05.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1662024-09-10T21:30:05.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
1672024-09-10T21:30:05.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1682024-09-10T21:30:05.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1692024-09-10T21:30:05.856ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.83975ms iteration = 12 status = 0
1702024-09-10T21:30:05.874ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
1712024-09-10T21:30:05.874ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1722024-09-10T21:30:05.874ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1343a529-ec11-4632-8f23-9b5e147f4fe3", "content-length": "26", "date": "Tue, 10 Sep 2024 21:30:05 GMT"} })
1732024-09-10T21:30:05.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1742024-09-10T21:30:05.876ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
1752024-09-10T21:30:05.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.364309ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1762024-09-10T21:30:05.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1772024-09-10T21:30:05.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1782024-09-10T21:30:05.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792024-09-10T21:30:05.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1802024-09-10T21:30:05.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1812024-09-10T21:30:05.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1822024-09-10T21:30:05.900ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
1832024-09-10T21:30:05.901ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1842024-09-10T21:30:05.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.737838ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
1852024-09-10T21:30:05.906ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.500535ms iteration = 15 status = {"physical_disks_added":0}
1862024-09-10T21:30:05.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1872024-09-10T21:30:05.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1882024-09-10T21:30:05.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1892024-09-10T21:30:05.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1902024-09-10T21:30:05.957ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1912024-09-10T21:30:05.959ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9c6c0ab-35cd-4297-9fed-25949cc3f4bf", "content-length": "1", "date": "Tue, 10 Sep 2024 21:30:05 GMT"} })
1922024-09-10T21:30:05.961ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1932024-09-10T21:30:05.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1942024-09-10T21:30:05.962ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.809179ms iteration = 12 status = null
1952024-09-10T21:30:06.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1962024-09-10T21:30:06.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78b5e84b-fe12-46be-aa6c-ec899d8fafc9", "content-length": "372", "date": "Tue, 10 Sep 2024 21:30:06 GMT"} })
1972024-09-10T21:30:06.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1982024-09-10T21:30:06.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1992024-09-10T21:30:06.028ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 264.22786ms iteration = 12 status = {}
2002024-09-10T21:30:06.038ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2012024-09-10T21:30:06.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c508febd-74da-4ed4-8754-a04d17b37294", "content-length": "691", "date": "Tue, 10 Sep 2024 21:30:06 GMT"} })
2022024-09-10T21:30:06.039ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2032024-09-10T21:30:06.039ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2042024-09-10T21:30:06.039ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2052024-09-10T21:30:06.040ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 276.448943ms iteration = 12 status = {}
2062024-09-10T21:30:06.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2072024-09-10T21:30:06.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2082024-09-10T21:30:06.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2092024-09-10T21:30:06.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2102024-09-10T21:30:06.046ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2112024-09-10T21:30:06.047ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "035c5cdc-66cd-4be2-aa9b-6d7634becf5b", "date": "Tue, 10 Sep 2024 21:30:06 GMT"} })
2122024-09-10T21:30:06.048ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.766571ms iteration = 13 status = {}
2132024-09-10T21:30:06.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2142024-09-10T21:30:06.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2152024-09-10T21:30:06.114ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
2162024-09-10T21:30:06.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2172024-09-10T21:30:06.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2182024-09-10T21:30:06.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2192024-09-10T21:30:06.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7baa3ab8-9ab5-49c7-b07d-6fcb1c8917d8", "content-length": "121", "date": "Tue, 10 Sep 2024 21:30:05 GMT"} })
2202024-09-10T21:30:06.130ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
2212024-09-10T21:30:06.130ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
2222024-09-10T21:30:06.130ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2232024-09-10T21:30:06.130ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2242024-09-10T21:30:06.130ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
2252024-09-10T21:30:06.130ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
2262024-09-10T21:30:06.130ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
2272024-09-10T21:30:06.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2282024-09-10T21:30:06.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2292024-09-10T21:30:06.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2302024-09-10T21:30:06.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "47a49bc2-99f9-4a68-b45d-9789568265e1", "content-length": "2", "date": "Tue, 10 Sep 2024 21:30:05 GMT"} })
2312024-09-10T21:30:06.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2322024-09-10T21:30:06.133ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fe1b0f04-116a-408d-bde9-5507c7e604fb", "content-length": "52", "date": "Tue, 10 Sep 2024 21:30:05 GMT"} })
2332024-09-10T21:30:06.133ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
2342024-09-10T21:30:06.133ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2352024-09-10T21:30:06.241ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f126633b-98fd-4072-942e-9a04501c1d56", "date": "Tue, 10 Sep 2024 21:30:06 GMT"} })
2362024-09-10T21:30:06.241ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
2372024-09-10T21:30:06.241ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2382024-09-10T21:30:06.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a441d69a-af7b-4cd3-be6a-9f7a663b2dea roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2392024-09-10T21:30:06.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a441d69a-af7b-4cd3-be6a-9f7a663b2dea resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2402024-09-10T21:30:06.243ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "393d10a5-628b-488d-a4cb-55effa5e8a6d", "content-length": "667", "date": "Tue, 10 Sep 2024 21:30:06 GMT"} })
2412024-09-10T21:30:06.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2422024-09-10T21:30:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2432024-09-10T21:30:06.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a441d69a-af7b-4cd3-be6a-9f7a663b2dea response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2442024-09-10T21:30:06.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2452024-09-10T21:30:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2462024-09-10T21:30:06.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2472024-09-10T21:30:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2482024-09-10T21:30:06.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2492024-09-10T21:30:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2502024-09-10T21:30:06.259ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 495.972324ms iteration = 12 status = {}
2512024-09-10T21:30:06.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 2a21d2e6-0b9a-4fd9-a283-1f0dd30a3362 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2522024-09-10T21:30:06.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 2a21d2e6-0b9a-4fd9-a283-1f0dd30a3362 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2532024-09-10T21:30:06.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 2a21d2e6-0b9a-4fd9-a283-1f0dd30a3362 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2542024-09-10T21:30:07.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3c89dae3-b409-4c0f-b768-55f3709d69de roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2552024-09-10T21:30:07.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3c89dae3-b409-4c0f-b768-55f3709d69de resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2562024-09-10T21:30:07.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3c89dae3-b409-4c0f-b768-55f3709d69de response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2572024-09-10T21:30:08.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8b273039-b19d-44ff-8d98-6449d05a1d29 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2582024-09-10T21:30:08.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8b273039-b19d-44ff-8d98-6449d05a1d29 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2592024-09-10T21:30:08.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8b273039-b19d-44ff-8d98-6449d05a1d29 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2602024-09-10T21:30:08.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1336 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = f5e59217-4106-4e43-8c79-703813258067 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
2612024-09-10T21:30:09.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 142decc6-f2bd-44d0-99df-469edc296e73 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2622024-09-10T21:30:09.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 142decc6-f2bd-44d0-99df-469edc296e73 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2632024-09-10T21:30:09.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 142decc6-f2bd-44d0-99df-469edc296e73 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2642024-09-10T21:30:10.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b54fdad1-90f3-4c2e-b0e1-fe7b4f92ba70 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2652024-09-10T21:30:10.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b54fdad1-90f3-4c2e-b0e1-fe7b4f92ba70 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2662024-09-10T21:30:10.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b54fdad1-90f3-4c2e-b0e1-fe7b4f92ba70 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2672024-09-10T21:30:11.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d0a09b9-8345-4beb-ac7f-5dde1dde107a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2682024-09-10T21:30:11.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d0a09b9-8345-4beb-ac7f-5dde1dde107a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2692024-09-10T21:30:11.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d0a09b9-8345-4beb-ac7f-5dde1dde107a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2702024-09-10T21:30:12.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3586e4aa-6006-4ce9-9da4-5702596d1a6f roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2712024-09-10T21:30:12.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3586e4aa-6006-4ce9-9da4-5702596d1a6f resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2722024-09-10T21:30:12.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3586e4aa-6006-4ce9-9da4-5702596d1a6f response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2732024-09-10T21:30:12.878ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55530
2742024-09-10T21:30:12.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55530 req_id = 739a4c03-bdc4-4618-91a0-4388e1fee163 roles = RoleSet { roles: {} } uri = /metrics/producers
2752024-09-10T21:30:12.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55530 req_id = 739a4c03-bdc4-4618-91a0-4388e1fee163 resource = Database result = Ok(()) uri = /metrics/producers
2762024-09-10T21:30:12.915ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
2772024-09-10T21:30:12.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55530 req_id = 739a4c03-bdc4-4618-91a0-4388e1fee163 roles = RoleSet { roles: {} } uri = /metrics/producers
2782024-09-10T21:30:12.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55530 req_id = 739a4c03-bdc4-4618-91a0-4388e1fee163 resource = Database result = Ok(()) uri = /metrics/producers
2792024-09-10T21:30:12.920ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
2802024-09-10T21:30:12.921ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dcf12533-526e-4043-9b15-ef712a51b485", "date": "Tue, 10 Sep 2024 21:30:12 GMT"} })
2812024-09-10T21:30:12.921ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 0b27b808-f7c7-4497-bde3-8c612f81f39f
2822024-09-10T21:30:12.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43123 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55530 req_id = 739a4c03-bdc4-4618-91a0-4388e1fee163 response_code = 201 uri = /metrics/producers
2832024-09-10T21:30:13.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0b447da6-3239-405c-a5eb-84c315071546 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2842024-09-10T21:30:13.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0b447da6-3239-405c-a5eb-84c315071546 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2852024-09-10T21:30:13.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0b447da6-3239-405c-a5eb-84c315071546 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2862024-09-10T21:30:14.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5bc5f6c0-3baa-4fd3-9119-c2114b0331e8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2872024-09-10T21:30:14.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5bc5f6c0-3baa-4fd3-9119-c2114b0331e8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2882024-09-10T21:30:14.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5bc5f6c0-3baa-4fd3-9119-c2114b0331e8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2892024-09-10T21:30:15.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6b5f57aa-cf88-40b7-8760-aae822e042db roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2902024-09-10T21:30:15.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6b5f57aa-cf88-40b7-8760-aae822e042db resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2912024-09-10T21:30:15.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6b5f57aa-cf88-40b7-8760-aae822e042db response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
2922024-09-10T21:30:15.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
2932024-09-10T21:30:15.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2942024-09-10T21:30:15.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2952024-09-10T21:30:15.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
2962024-09-10T21:30:15.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2972024-09-10T21:30:15.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2982024-09-10T21:30:15.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2992024-09-10T21:30:15.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3002024-09-10T21:30:15.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3012024-09-10T21:30:15.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3022024-09-10T21:30:15.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3032024-09-10T21:30:15.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.45577ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3042024-09-10T21:30:15.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3052024-09-10T21:30:15.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3062024-09-10T21:30:15.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3072024-09-10T21:30:15.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3082024-09-10T21:30:15.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
3092024-09-10T21:30:15.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3102024-09-10T21:30:15.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3112024-09-10T21:30:15.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
3122024-09-10T21:30:15.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.775828ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
3132024-09-10T21:30:16.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8b23ab19-0cf8-494e-bafb-aa732d8f053b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3142024-09-10T21:30:16.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8b23ab19-0cf8-494e-bafb-aa732d8f053b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3152024-09-10T21:30:16.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8b23ab19-0cf8-494e-bafb-aa732d8f053b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3162024-09-10T21:30:17.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 95524021-7e32-4251-be79-0dc0aced9cc6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3172024-09-10T21:30:17.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 95524021-7e32-4251-be79-0dc0aced9cc6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3182024-09-10T21:30:17.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 95524021-7e32-4251-be79-0dc0aced9cc6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3192024-09-10T21:30:18.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f878652-07d1-454a-aa20-823c07d95b49 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3202024-09-10T21:30:18.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f878652-07d1-454a-aa20-823c07d95b49 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3212024-09-10T21:30:18.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f878652-07d1-454a-aa20-823c07d95b49 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3222024-09-10T21:30:18.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1309 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = f314766e-1f53-4bd8-9756-ebf39c95b846 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
3232024-09-10T21:30:19.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ca07366b-5398-4bcd-947c-d67673209f06 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3242024-09-10T21:30:19.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ca07366b-5398-4bcd-947c-d67673209f06 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3252024-09-10T21:30:19.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ca07366b-5398-4bcd-947c-d67673209f06 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3262024-09-10T21:30:20.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 80300223-1548-4512-b602-d836f5608b50 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3272024-09-10T21:30:20.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 80300223-1548-4512-b602-d836f5608b50 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3282024-09-10T21:30:20.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 80300223-1548-4512-b602-d836f5608b50 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3292024-09-10T21:30:21.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eec63e9a-60f2-4b30-8c6e-4dffb5947ba4 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3302024-09-10T21:30:21.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eec63e9a-60f2-4b30-8c6e-4dffb5947ba4 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3312024-09-10T21:30:21.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eec63e9a-60f2-4b30-8c6e-4dffb5947ba4 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3322024-09-10T21:30:22.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 08cfe12f-8816-4da8-9a84-f65ee70989b4 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3332024-09-10T21:30:22.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 08cfe12f-8816-4da8-9a84-f65ee70989b4 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3342024-09-10T21:30:22.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 08cfe12f-8816-4da8-9a84-f65ee70989b4 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3352024-09-10T21:30:23.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 853bc44f-e010-4550-95ef-401c09152f61 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3362024-09-10T21:30:23.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 853bc44f-e010-4550-95ef-401c09152f61 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3372024-09-10T21:30:23.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 853bc44f-e010-4550-95ef-401c09152f61 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3382024-09-10T21:30:24.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c8eab3f4-bd4e-4b41-a312-f8a49c8995de roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3392024-09-10T21:30:24.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c8eab3f4-bd4e-4b41-a312-f8a49c8995de resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3402024-09-10T21:30:24.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c8eab3f4-bd4e-4b41-a312-f8a49c8995de response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3412024-09-10T21:30:25.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f92fecd-7581-4003-96ba-18d9643b5181 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3422024-09-10T21:30:25.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f92fecd-7581-4003-96ba-18d9643b5181 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3432024-09-10T21:30:25.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f92fecd-7581-4003-96ba-18d9643b5181 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3442024-09-10T21:30:25.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
3452024-09-10T21:30:25.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3462024-09-10T21:30:25.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3472024-09-10T21:30:25.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
3482024-09-10T21:30:25.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3492024-09-10T21:30:25.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3502024-09-10T21:30:25.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512024-09-10T21:30:25.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3522024-09-10T21:30:25.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3532024-09-10T21:30:25.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3542024-09-10T21:30:25.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3552024-09-10T21:30:25.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3562024-09-10T21:30:25.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3572024-09-10T21:30:25.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3582024-09-10T21:30:25.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3592024-09-10T21:30:25.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
3602024-09-10T21:30:25.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3612024-09-10T21:30:25.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3622024-09-10T21:30:25.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
3632024-09-10T21:30:25.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.93226ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
3642024-09-10T21:30:25.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.78171ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3652024-09-10T21:30:26.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 084e0bc8-8e1e-4522-b007-adf43261c7ee roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3662024-09-10T21:30:26.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 084e0bc8-8e1e-4522-b007-adf43261c7ee resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3672024-09-10T21:30:26.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 084e0bc8-8e1e-4522-b007-adf43261c7ee response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3682024-09-10T21:30:27.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 480c2772-0f49-4fd0-95b2-1418d20b4aea roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3692024-09-10T21:30:27.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 480c2772-0f49-4fd0-95b2-1418d20b4aea resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3702024-09-10T21:30:27.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 480c2772-0f49-4fd0-95b2-1418d20b4aea response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3712024-09-10T21:30:28.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 96e633e4-d141-4da8-b6a3-619734377770 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3722024-09-10T21:30:28.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 96e633e4-d141-4da8-b6a3-619734377770 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3732024-09-10T21:30:28.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 96e633e4-d141-4da8-b6a3-619734377770 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3742024-09-10T21:30:28.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1314 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 760333c5-5409-4d98-a6f6-dc099e7f79af response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
3752024-09-10T21:30:29.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7cc9b40f-1487-4f5b-a352-3e22a6b97fdd roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3762024-09-10T21:30:29.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7cc9b40f-1487-4f5b-a352-3e22a6b97fdd resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3772024-09-10T21:30:29.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7cc9b40f-1487-4f5b-a352-3e22a6b97fdd response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3782024-09-10T21:30:30.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dc3af504-4f51-4ebd-8690-ae740ea1ca7b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3792024-09-10T21:30:30.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dc3af504-4f51-4ebd-8690-ae740ea1ca7b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3802024-09-10T21:30:30.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dc3af504-4f51-4ebd-8690-ae740ea1ca7b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3812024-09-10T21:30:31.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 467f879a-c937-459f-b013-589f594cdeda roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3822024-09-10T21:30:31.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 467f879a-c937-459f-b013-589f594cdeda resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3832024-09-10T21:30:31.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 467f879a-c937-459f-b013-589f594cdeda response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3842024-09-10T21:30:32.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 651a66ea-5176-41ca-9109-f4604f340103 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3852024-09-10T21:30:32.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 651a66ea-5176-41ca-9109-f4604f340103 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3862024-09-10T21:30:32.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 651a66ea-5176-41ca-9109-f4604f340103 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3872024-09-10T21:30:33.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c5d11b44-1b0d-4c06-8690-9064ce960755 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3882024-09-10T21:30:33.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c5d11b44-1b0d-4c06-8690-9064ce960755 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3892024-09-10T21:30:33.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c5d11b44-1b0d-4c06-8690-9064ce960755 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3902024-09-10T21:30:34.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e139a2cc-a4ae-4fcf-a1ed-0e63e73ad56c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3912024-09-10T21:30:34.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e139a2cc-a4ae-4fcf-a1ed-0e63e73ad56c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3922024-09-10T21:30:34.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e139a2cc-a4ae-4fcf-a1ed-0e63e73ad56c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
3932024-09-10T21:30:35.763ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
3942024-09-10T21:30:35.763ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
3952024-09-10T21:30:35.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3962024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3972024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
3982024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3992024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4002024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
4012024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
4022024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
4032024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4042024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4052024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
4062024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
4072024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4082024-09-10T21:30:35.764ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f
4092024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
4102024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.341\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f"}
4112024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
4122024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
4132024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
4142024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4152024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4162024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
4172024-09-10T21:30:35.764ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4182024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4192024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
4202024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
4212024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
4222024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4232024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4242024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4252024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
4262024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4272024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
4282024-09-10T21:30:35.764ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-10 21:20:35.764152004 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4292024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4302024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
4312024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
4322024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4332024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4342024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
4352024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
4362024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
4372024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4382024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
4392024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4402024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4412024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4422024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
4432024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4442024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4452024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4462024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
4472024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
4482024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
4492024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4502024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4512024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4522024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4532024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
4542024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
4552024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4562024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4572024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4582024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4592024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4602024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4612024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4622024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4632024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4642024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4652024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4662024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4672024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4682024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4692024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4702024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4712024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4722024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4732024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4742024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4752024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4762024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4772024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4782024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4792024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4802024-09-10T21:30:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4812024-09-10T21:30:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4822024-09-10T21:30:35.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4832024-09-10T21:30:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4842024-09-10T21:30:35.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4852024-09-10T21:30:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4862024-09-10T21:30:35.765ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22ec8121-6583-4054-9535-d2454e5c4dec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2787, tv_nsec: 283441923 } })
4872024-09-10T21:30:35.765ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48d3ebb5-3dc4-4b69-a505-4bb07f9482ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94337c1c-5cb5-4050-bd90-d4c50dd633f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2787, tv_nsec: 283559965 } })
4882024-09-10T21:30:35.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4892024-09-10T21:30:35.766ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4902024-09-10T21:30:35.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4912024-09-10T21:30:35.767ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
4922024-09-10T21:30:35.767ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.243736ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4932024-09-10T21:30:35.767ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.277157ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4942024-09-10T21:30:35.767ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
4952024-09-10T21:30:35.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.944778ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
4962024-09-10T21:30:35.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972024-09-10T21:30:35.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4982024-09-10T21:30:35.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4992024-09-10T21:30:35.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5002024-09-10T21:30:35.769ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012024-09-10T21:30:35.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2787, tv_nsec: 287286090 } })
5022024-09-10T21:30:35.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
5032024-09-10T21:30:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5042024-09-10T21:30:35.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5052024-09-10T21:30:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5062024-09-10T21:30:35.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5072024-09-10T21:30:35.771ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-09-10T21:30:35.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5092024-09-10T21:30:35.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5102024-09-10T21:30:35.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5112024-09-10T21:30:35.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5122024-09-10T21:30:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5132024-09-10T21:30:35.773ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5142024-09-10T21:30:35.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2787, tv_nsec: 291437733 } })
5152024-09-10T21:30:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5162024-09-10T21:30:35.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5172024-09-10T21:30:35.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5182024-09-10T21:30:35.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5192024-09-10T21:30:35.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5202024-09-10T21:30:35.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
5212024-09-10T21:30:35.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5222024-09-10T21:30:35.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5232024-09-10T21:30:35.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5242024-09-10T21:30:35.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5252024-09-10T21:30:35.778ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-10 21:20:35.764152004 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5262024-09-10T21:30:35.778ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.964353ms iteration = 7 status = {"expiration":"2024-09-10T21:20:35.764152004Z","pruned":[]}
5272024-09-10T21:30:35.778ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.036595ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
5282024-09-10T21:30:35.779ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292024-09-10T21:30:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5302024-09-10T21:30:35.782ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5312024-09-10T21:30:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5322024-09-10T21:30:35.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5332024-09-10T21:30:35.786ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2787, tv_nsec: 303825569 } })
5342024-09-10T21:30:35.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5352024-09-10T21:30:35.786ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
5362024-09-10T21:30:35.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372024-09-10T21:30:35.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5382024-09-10T21:30:35.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5392024-09-10T21:30:35.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5402024-09-10T21:30:35.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5412024-09-10T21:30:35.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5422024-09-10T21:30:35.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-09-10T21:30:35.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.270722ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
5442024-09-10T21:30:35.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5452024-09-10T21:30:35.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5462024-09-10T21:30:35.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5472024-09-10T21:30:35.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482024-09-10T21:30:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5492024-09-10T21:30:35.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5502024-09-10T21:30:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5512024-09-10T21:30:35.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5522024-09-10T21:30:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5532024-09-10T21:30:35.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542024-09-10T21:30:35.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5552024-09-10T21:30:35.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5562024-09-10T21:30:35.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5572024-09-10T21:30:35.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5582024-09-10T21:30:35.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5592024-09-10T21:30:35.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5602024-09-10T21:30:35.823ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5612024-09-10T21:30:35.823ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5622024-09-10T21:30:35.823ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.02762ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5632024-09-10T21:30:35.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5642024-09-10T21:30:35.824ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
5652024-09-10T21:30:35.824ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5662024-09-10T21:30:35.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5672024-09-10T21:30:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5682024-09-10T21:30:35.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5692024-09-10T21:30:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5702024-09-10T21:30:35.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5712024-09-10T21:30:35.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5722024-09-10T21:30:35.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.50624ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
5732024-09-10T21:30:35.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.03201ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
5742024-09-10T21:30:35.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
5752024-09-10T21:30:35.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5762024-09-10T21:30:35.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5772024-09-10T21:30:35.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5782024-09-10T21:30:35.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5792024-09-10T21:30:35.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5802024-09-10T21:30:35.830ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5812024-09-10T21:30:35.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822024-09-10T21:30:35.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5832024-09-10T21:30:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5842024-09-10T21:30:35.832ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5852024-09-10T21:30:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5862024-09-10T21:30:35.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5872024-09-10T21:30:35.834ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5882024-09-10T21:30:35.834ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5892024-09-10T21:30:35.834ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.960291ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5902024-09-10T21:30:35.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912024-09-10T21:30:35.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5922024-09-10T21:30:35.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5932024-09-10T21:30:35.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5942024-09-10T21:30:35.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5952024-09-10T21:30:35.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5962024-09-10T21:30:35.836ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-09-10T21:30:35.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-09-10T21:30:35.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5992024-09-10T21:30:35.838ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6002024-09-10T21:30:35.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6012024-09-10T21:30:35.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6022024-09-10T21:30:35.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
6032024-09-10T21:30:35.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.397863ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
6042024-09-10T21:30:35.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6052024-09-10T21:30:35.842ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.636212ms iteration = 4 status = {"nsuccess":5}
6062024-09-10T21:30:35.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6072024-09-10T21:30:35.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6082024-09-10T21:30:35.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6092024-09-10T21:30:35.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6102024-09-10T21:30:35.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6112024-09-10T21:30:35.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
6122024-09-10T21:30:35.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6132024-09-10T21:30:35.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6142024-09-10T21:30:35.856ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.467374ms iteration = 13 status = 0
6152024-09-10T21:30:35.859ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.507196ms iteration = 16 status = {"physical_disks_added":0}
6162024-09-10T21:30:35.859ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
6172024-09-10T21:30:35.859ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6182024-09-10T21:30:35.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6192024-09-10T21:30:35.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.386724ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6202024-09-10T21:30:35.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6212024-09-10T21:30:35.860ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6222024-09-10T21:30:35.861ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.512494ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6232024-09-10T21:30:35.861ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
6242024-09-10T21:30:35.861ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6252024-09-10T21:30:35.861ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.680597ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
6262024-09-10T21:30:35.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6272024-09-10T21:30:35.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6282024-09-10T21:30:35.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6292024-09-10T21:30:35.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6302024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6312024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6322024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6332024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6342024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6352024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6362024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6372024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6382024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6392024-09-10T21:30:35.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6402024-09-10T21:30:35.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6412024-09-10T21:30:35.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6422024-09-10T21:30:35.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6432024-09-10T21:30:35.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6442024-09-10T21:30:35.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.975374ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6452024-09-10T21:30:35.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6462024-09-10T21:30:35.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6472024-09-10T21:30:35.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6482024-09-10T21:30:35.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6492024-09-10T21:30:35.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6502024-09-10T21:30:35.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6512024-09-10T21:30:35.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cd4c0a87-1f75-4610-b51a-48b39bbc32c4 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
6522024-09-10T21:30:35.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cd4c0a87-1f75-4610-b51a-48b39bbc32c4 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
6532024-09-10T21:30:35.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cd4c0a87-1f75-4610-b51a-48b39bbc32c4 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
6542024-09-10T21:30:35.891ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6552024-09-10T21:30:35.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6562024-09-10T21:30:35.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6572024-09-10T21:30:35.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6582024-09-10T21:30:35.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6592024-09-10T21:30:35.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6602024-09-10T21:30:35.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6612024-09-10T21:30:35.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6622024-09-10T21:30:35.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6632024-09-10T21:30:35.907ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6642024-09-10T21:30:35.907ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 0 version = 2
6652024-09-10T21:30:35.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6662024-09-10T21:30:35.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6672024-09-10T21:30:35.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.815431ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6682024-09-10T21:30:35.914ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6692024-09-10T21:30:35.914ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6702024-09-10T21:30:35.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6712024-09-10T21:30:35.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6722024-09-10T21:30:35.915ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6732024-09-10T21:30:35.915ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6742024-09-10T21:30:35.916ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e146130b-1e62-4563-959d-8694a7f074d6", "content-length": "26", "date": "Tue, 10 Sep 2024 21:30:35 GMT"} })
6752024-09-10T21:30:35.916ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6762024-09-10T21:30:35.917ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6772024-09-10T21:30:35.923ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6782024-09-10T21:30:35.942ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-10T21:24:32.656983Z, time_modified: 2024-09-10T21:24:32.656983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }) }
6792024-09-10T21:30:35.942ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 178.803119ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]}},"default_endpoint":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
6802024-09-10T21:30:35.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6812024-09-10T21:30:35.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6822024-09-10T21:30:36.074ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
6832024-09-10T21:30:36.074ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6842024-09-10T21:30:36.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "454a628b-91d9-417f-bc76-54f4509c7356", "content-length": "372", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} })
6852024-09-10T21:30:36.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6862024-09-10T21:30:36.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6872024-09-10T21:30:36.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882024-09-10T21:30:36.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6892024-09-10T21:30:36.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6902024-09-10T21:30:36.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6912024-09-10T21:30:36.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6922024-09-10T21:30:36.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6932024-09-10T21:30:36.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6942024-09-10T21:30:36.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6952024-09-10T21:30:36.091ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
6962024-09-10T21:30:36.091ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
6972024-09-10T21:30:36.091ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-10 21:24:36.002618 UTC dns_group = internal generation = 1
6982024-09-10T21:30:36.091ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 327.343611ms iteration = 8 status = {"generation":1}
6992024-09-10T21:30:36.091ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7002024-09-10T21:30:36.091ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7012024-09-10T21:30:36.092ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69930bcd-1def-4017-8c20-7fc1444a0a9b", "content-length": "1", "date": "Tue, 10 Sep 2024 21:30:35 GMT"} })
7022024-09-10T21:30:36.092ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6a2a8005-c818-42ac-8b52-408d7235c140", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} })
7032024-09-10T21:30:36.092ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
7042024-09-10T21:30:36.092ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7052024-09-10T21:30:36.094ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e25228b-ba09-435a-9947-e8e396746a52", "content-length": "26", "date": "Tue, 10 Sep 2024 21:30:35 GMT"} })
7062024-09-10T21:30:36.094ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7072024-09-10T21:30:36.110ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 346.061508ms iteration = 14 status = {}
7082024-09-10T21:30:36.110ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7092024-09-10T21:30:36.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7102024-09-10T21:30:36.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
7112024-09-10T21:30:36.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
7122024-09-10T21:30:36.112ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7132024-09-10T21:30:36.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80da0d83-7495-4946-b3eb-8e30da55ef97", "content-length": "26", "date": "Tue, 10 Sep 2024 21:30:35 GMT"} })
7142024-09-10T21:30:36.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7152024-09-10T21:30:36.114ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 350.346213ms iteration = 13 status = null
7162024-09-10T21:30:36.115ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7172024-09-10T21:30:36.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-09-10T21:30:36.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7192024-09-10T21:30:36.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7202024-09-10T21:30:36.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7212024-09-10T21:30:36.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7222024-09-10T21:30:36.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7232024-09-10T21:30:36.136ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 1 version = 2
7242024-09-10T21:30:36.136ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7252024-09-10T21:30:36.136ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-10 21:24:37.242901 UTC dns_group = external generation = 2
7262024-09-10T21:30:36.136ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 372.692083ms iteration = 8 status = {"generation":2}
7272024-09-10T21:30:36.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7282024-09-10T21:30:36.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7292024-09-10T21:30:36.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7302024-09-10T21:30:36.140ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7312024-09-10T21:30:36.141ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7fad7ae0-fa1b-4ed0-8312-56c4aca7dc6b", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7322024-09-10T21:30:36.141ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7332024-09-10T21:30:36.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7342024-09-10T21:30:36.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7352024-09-10T21:30:36.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7362024-09-10T21:30:36.143ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "90300ecd-d970-409b-b18d-60474db6d603", "date": "Tue, 10 Sep 2024 21:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7372024-09-10T21:30:36.143ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7382024-09-10T21:30:36.148ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7392024-09-10T21:30:36.148ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 384.04604ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7402024-09-10T21:30:36.201ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7412024-09-10T21:30:36.202ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f2fec753-8541-4dd5-842d-839e74b9ed75", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7422024-09-10T21:30:36.202ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7432024-09-10T21:30:36.204ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d24887e0-3c44-4b25-8afa-51eac6ced132", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7442024-09-10T21:30:36.204ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7452024-09-10T21:30:36.206ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f11e7ae5-10f1-469a-903b-e6dcb144ad35", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7462024-09-10T21:30:36.206ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7472024-09-10T21:30:36.209ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7482024-09-10T21:30:36.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 445.428682ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7492024-09-10T21:30:36.242ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 478.56705ms iteration = 13 status = {}
7502024-09-10T21:30:36.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7512024-09-10T21:30:36.297ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7e5d3018-f03b-4f00-925f-c380499ce94a", "content-length": "691", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} })
7522024-09-10T21:30:36.297ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7532024-09-10T21:30:36.297ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7542024-09-10T21:30:36.297ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7552024-09-10T21:30:36.298ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 534.937674ms iteration = 13 status = {}
7562024-09-10T21:30:36.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7572024-09-10T21:30:36.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7582024-09-10T21:30:36.336ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
7592024-09-10T21:30:36.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7602024-09-10T21:30:36.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7612024-09-10T21:30:36.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7622024-09-10T21:30:36.347ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "56d69f33-85d4-41f1-bf83-a150105d0c0b", "content-length": "121", "date": "Tue, 10 Sep 2024 21:30:35 GMT"} })
7632024-09-10T21:30:36.347ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
7642024-09-10T21:30:36.347ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
7652024-09-10T21:30:36.347ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7662024-09-10T21:30:36.347ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7672024-09-10T21:30:36.347ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
7682024-09-10T21:30:36.347ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
7692024-09-10T21:30:36.347ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
7702024-09-10T21:30:36.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7712024-09-10T21:30:36.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7722024-09-10T21:30:36.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7732024-09-10T21:30:36.349ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb20e65-64b8-49f7-9edf-de82e4e3aee4", "content-length": "2", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} })
7742024-09-10T21:30:36.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7752024-09-10T21:30:36.350ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c2f7a5fa-2ac8-4f5b-8092-aedf13a4bcc0", "content-length": "52", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} })
7762024-09-10T21:30:36.350ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
7772024-09-10T21:30:36.350ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7782024-09-10T21:30:36.446ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "54a7ce61-f2ba-42b5-aea9-7378ed49d1f7", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} })
7792024-09-10T21:30:36.446ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
7802024-09-10T21:30:36.446ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7812024-09-10T21:30:36.447ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e1b75cac-ce78-4533-b16f-b48b45438ae3", "content-length": "667", "date": "Tue, 10 Sep 2024 21:30:36 GMT"} })
7822024-09-10T21:30:36.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7832024-09-10T21:30:36.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7842024-09-10T21:30:36.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7852024-09-10T21:30:36.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7862024-09-10T21:30:36.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7872024-09-10T21:30:36.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7882024-09-10T21:30:36.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7892024-09-10T21:30:36.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7902024-09-10T21:30:36.466ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 702.906424ms iteration = 13 status = {}
7912024-09-10T21:30:36.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = a1960bb4-b1a7-4373-8558-5d4322aac03c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7922024-09-10T21:30:36.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = a1960bb4-b1a7-4373-8558-5d4322aac03c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7932024-09-10T21:30:36.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = a1960bb4-b1a7-4373-8558-5d4322aac03c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7942024-09-10T21:30:36.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ca730d2-8b7c-41af-b767-c85e0173fddc roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
7952024-09-10T21:30:36.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ca730d2-8b7c-41af-b767-c85e0173fddc resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
7962024-09-10T21:30:36.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ca730d2-8b7c-41af-b767-c85e0173fddc response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
7972024-09-10T21:30:37.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7479e403-74b9-4cde-807f-d7f278d83a9a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
7982024-09-10T21:30:37.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7479e403-74b9-4cde-807f-d7f278d83a9a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
7992024-09-10T21:30:37.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7479e403-74b9-4cde-807f-d7f278d83a9a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8002024-09-10T21:30:38.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1340 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = ee4e3266-2c2d-4fe3-970c-addc26caed1c response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
8012024-09-10T21:30:38.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = bb3dc70f-d2c2-4c49-a3eb-dd8964a26719 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8022024-09-10T21:30:38.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = bb3dc70f-d2c2-4c49-a3eb-dd8964a26719 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8032024-09-10T21:30:38.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = bb3dc70f-d2c2-4c49-a3eb-dd8964a26719 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8042024-09-10T21:30:39.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5e8678ac-f7ef-427e-b5f9-ff5ca1bc62d8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8052024-09-10T21:30:39.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5e8678ac-f7ef-427e-b5f9-ff5ca1bc62d8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8062024-09-10T21:30:39.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5e8678ac-f7ef-427e-b5f9-ff5ca1bc62d8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8072024-09-10T21:30:40.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7a58d6d2-f0b8-4afd-ae0b-51e984640b04 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8082024-09-10T21:30:40.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7a58d6d2-f0b8-4afd-ae0b-51e984640b04 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8092024-09-10T21:30:41.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7a58d6d2-f0b8-4afd-ae0b-51e984640b04 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8102024-09-10T21:30:42.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 71f3e355-f8a6-443c-8c12-241d9326f320 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8112024-09-10T21:30:42.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 71f3e355-f8a6-443c-8c12-241d9326f320 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8122024-09-10T21:30:42.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 71f3e355-f8a6-443c-8c12-241d9326f320 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8132024-09-10T21:30:43.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 473b81f8-2653-4716-a6b3-a1f62ec85ebf roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8142024-09-10T21:30:43.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 473b81f8-2653-4716-a6b3-a1f62ec85ebf resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8152024-09-10T21:30:43.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 473b81f8-2653-4716-a6b3-a1f62ec85ebf response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8162024-09-10T21:30:44.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 89a37773-656d-4f41-bcc2-b8c9a82ec077 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8172024-09-10T21:30:44.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 89a37773-656d-4f41-bcc2-b8c9a82ec077 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8182024-09-10T21:30:44.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 89a37773-656d-4f41-bcc2-b8c9a82ec077 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8192024-09-10T21:30:45.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c0fedea8-809c-45af-8744-cd5bfc6383ca roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8202024-09-10T21:30:45.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c0fedea8-809c-45af-8744-cd5bfc6383ca resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8212024-09-10T21:30:45.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c0fedea8-809c-45af-8744-cd5bfc6383ca response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8222024-09-10T21:30:45.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
8232024-09-10T21:30:45.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8242024-09-10T21:30:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8252024-09-10T21:30:45.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
8262024-09-10T21:30:45.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8272024-09-10T21:30:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8282024-09-10T21:30:45.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8292024-09-10T21:30:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8302024-09-10T21:30:45.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8312024-09-10T21:30:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8322024-09-10T21:30:45.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8332024-09-10T21:30:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8342024-09-10T21:30:45.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8352024-09-10T21:30:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8362024-09-10T21:30:45.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8372024-09-10T21:30:45.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
8382024-09-10T21:30:45.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8392024-09-10T21:30:45.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8402024-09-10T21:30:45.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
8412024-09-10T21:30:45.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.462316ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
8422024-09-10T21:30:45.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.167997ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8432024-09-10T21:30:46.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ce1c4a52-8d1e-4a37-9e89-6baef104bfcf roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8442024-09-10T21:30:46.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ce1c4a52-8d1e-4a37-9e89-6baef104bfcf resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8452024-09-10T21:30:46.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ce1c4a52-8d1e-4a37-9e89-6baef104bfcf response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8462024-09-10T21:30:47.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d8490b7d-44a3-4d0b-b9a9-f47456a46894 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8472024-09-10T21:30:47.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d8490b7d-44a3-4d0b-b9a9-f47456a46894 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8482024-09-10T21:30:47.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d8490b7d-44a3-4d0b-b9a9-f47456a46894 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8492024-09-10T21:30:48.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 874499bf-09fe-4c2c-8a0d-e438dea28a08 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8502024-09-10T21:30:48.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 874499bf-09fe-4c2c-8a0d-e438dea28a08 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8512024-09-10T21:30:48.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 874499bf-09fe-4c2c-8a0d-e438dea28a08 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8522024-09-10T21:30:48.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1621 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 3dbc88d6-ac65-47f9-8189-1ce1b1a95000 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
8532024-09-10T21:30:49.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c3c9a08-d6a0-48a8-af81-d8a7766121e6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8542024-09-10T21:30:49.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c3c9a08-d6a0-48a8-af81-d8a7766121e6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8552024-09-10T21:30:49.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c3c9a08-d6a0-48a8-af81-d8a7766121e6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8562024-09-10T21:30:50.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c2569e58-30bb-4ba6-af24-2cefa2eac016 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8572024-09-10T21:30:50.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c2569e58-30bb-4ba6-af24-2cefa2eac016 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8582024-09-10T21:30:50.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c2569e58-30bb-4ba6-af24-2cefa2eac016 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8592024-09-10T21:30:51.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eda9ab2a-75cc-4e26-b341-9674f7e94ec8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8602024-09-10T21:30:51.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eda9ab2a-75cc-4e26-b341-9674f7e94ec8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8612024-09-10T21:30:51.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eda9ab2a-75cc-4e26-b341-9674f7e94ec8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8622024-09-10T21:30:52.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a6ca6b57-e05e-4cb4-af3b-d05c2c5ac5ca roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8632024-09-10T21:30:52.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a6ca6b57-e05e-4cb4-af3b-d05c2c5ac5ca resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8642024-09-10T21:30:52.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a6ca6b57-e05e-4cb4-af3b-d05c2c5ac5ca response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8652024-09-10T21:30:53.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8d70fc73-c707-4425-8d4d-b1d3d94ba866 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8662024-09-10T21:30:53.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8d70fc73-c707-4425-8d4d-b1d3d94ba866 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8672024-09-10T21:30:53.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8d70fc73-c707-4425-8d4d-b1d3d94ba866 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8682024-09-10T21:30:54.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4f529383-30ab-426e-84d0-9053a14fae4d roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8692024-09-10T21:30:54.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4f529383-30ab-426e-84d0-9053a14fae4d resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8702024-09-10T21:30:54.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4f529383-30ab-426e-84d0-9053a14fae4d response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8712024-09-10T21:30:55.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8d8a8178-3f9d-4bc7-bcb4-37ad5901f853 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8722024-09-10T21:30:55.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8d8a8178-3f9d-4bc7-bcb4-37ad5901f853 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8732024-09-10T21:30:55.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8d8a8178-3f9d-4bc7-bcb4-37ad5901f853 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8742024-09-10T21:30:55.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
8752024-09-10T21:30:55.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8762024-09-10T21:30:55.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8772024-09-10T21:30:55.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
8782024-09-10T21:30:55.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8792024-09-10T21:30:55.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8802024-09-10T21:30:55.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8812024-09-10T21:30:55.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8822024-09-10T21:30:55.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8832024-09-10T21:30:55.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8842024-09-10T21:30:55.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8852024-09-10T21:30:55.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8862024-09-10T21:30:55.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8872024-09-10T21:30:55.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8882024-09-10T21:30:55.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8892024-09-10T21:30:55.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
8902024-09-10T21:30:55.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8912024-09-10T21:30:55.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8922024-09-10T21:30:55.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
8932024-09-10T21:30:55.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.767648ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
8942024-09-10T21:30:55.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.981488ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8952024-09-10T21:30:56.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cb23c767-83c4-497a-a399-3dd2e1cbb842 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8962024-09-10T21:30:56.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cb23c767-83c4-497a-a399-3dd2e1cbb842 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8972024-09-10T21:30:56.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cb23c767-83c4-497a-a399-3dd2e1cbb842 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8982024-09-10T21:30:57.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb218cdf-05ab-40ee-8126-294f0e4c2835 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
8992024-09-10T21:30:57.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb218cdf-05ab-40ee-8126-294f0e4c2835 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9002024-09-10T21:30:57.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb218cdf-05ab-40ee-8126-294f0e4c2835 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9012024-09-10T21:30:58.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4dcc2d15-022d-465d-9252-abe9ab1f5d0b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9022024-09-10T21:30:58.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4dcc2d15-022d-465d-9252-abe9ab1f5d0b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9032024-09-10T21:30:58.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4dcc2d15-022d-465d-9252-abe9ab1f5d0b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9042024-09-10T21:30:58.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1328 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = aa224eb9-b5f0-4aaf-aab3-7f926d0db857 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
9052024-09-10T21:30:59.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c46ae335-d5ba-4093-a7c1-e92be58c8992 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9062024-09-10T21:30:59.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c46ae335-d5ba-4093-a7c1-e92be58c8992 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9072024-09-10T21:30:59.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c46ae335-d5ba-4093-a7c1-e92be58c8992 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9082024-09-10T21:31:00.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f0db60e9-295b-44cd-be29-6b8b7b5eb562 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9092024-09-10T21:31:00.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f0db60e9-295b-44cd-be29-6b8b7b5eb562 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9102024-09-10T21:31:00.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f0db60e9-295b-44cd-be29-6b8b7b5eb562 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9112024-09-10T21:31:01.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c27e5bd4-3cf1-44e5-9153-0396fc801298 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9122024-09-10T21:31:01.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c27e5bd4-3cf1-44e5-9153-0396fc801298 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9132024-09-10T21:31:01.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c27e5bd4-3cf1-44e5-9153-0396fc801298 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9142024-09-10T21:31:02.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ab5e44ff-5ac4-4054-9852-c2d6a9e93782 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9152024-09-10T21:31:02.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ab5e44ff-5ac4-4054-9852-c2d6a9e93782 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9162024-09-10T21:31:02.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ab5e44ff-5ac4-4054-9852-c2d6a9e93782 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9172024-09-10T21:31:03.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f170ceed-0d2d-4f92-a6a9-1436e428f290 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9182024-09-10T21:31:03.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f170ceed-0d2d-4f92-a6a9-1436e428f290 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9192024-09-10T21:31:03.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f170ceed-0d2d-4f92-a6a9-1436e428f290 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9202024-09-10T21:31:04.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 19e3b60b-5804-4c67-9ee4-2a8beac7debe roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9212024-09-10T21:31:04.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 19e3b60b-5804-4c67-9ee4-2a8beac7debe resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9222024-09-10T21:31:04.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 19e3b60b-5804-4c67-9ee4-2a8beac7debe response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9232024-09-10T21:31:05.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 59c3d208-3a1e-4782-959a-80bfbf5d11e8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9242024-09-10T21:31:05.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 59c3d208-3a1e-4782-959a-80bfbf5d11e8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9252024-09-10T21:31:05.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 59c3d208-3a1e-4782-959a-80bfbf5d11e8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
9262024-09-10T21:31:05.763ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
9272024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9282024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
9292024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
9302024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9312024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9322024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
9332024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
9342024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
9352024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9362024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
9372024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9392024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
9402024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
9412024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9422024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9432024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9442024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9452024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9462024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9472024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9482024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9492024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9502024-09-10T21:31:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9512024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
9522024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
9532024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9542024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9552024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9562024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
9572024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
9582024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9592024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
9602024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9612024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9622024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
9632024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9642024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
9652024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9662024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
9672024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9682024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9692024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9702024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9712024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9722024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9732024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9742024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9752024-09-10T21:31:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9762024-09-10T21:31:05.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9772024-09-10T21:31:05.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782024-09-10T21:31:05.767ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2817, tv_nsec: 284761816 } })
9792024-09-10T21:31:05.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9802024-09-10T21:31:05.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9812024-09-10T21:31:05.767ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.775606ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9822024-09-10T21:31:05.767ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
9832024-09-10T21:31:05.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9842024-09-10T21:31:05.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9852024-09-10T21:31:05.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9862024-09-10T21:31:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9872024-09-10T21:31:05.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9882024-09-10T21:31:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9892024-09-10T21:31:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9902024-09-10T21:31:05.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9912024-09-10T21:31:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9922024-09-10T21:31:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9932024-09-10T21:31:05.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9942024-09-10T21:31:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9952024-09-10T21:31:05.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2817, tv_nsec: 290146320 } })
9962024-09-10T21:31:05.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
9972024-09-10T21:31:05.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9982024-09-10T21:31:05.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.20814ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
9992024-09-10T21:31:05.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10002024-09-10T21:31:05.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10012024-09-10T21:31:05.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10022024-09-10T21:31:05.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10032024-09-10T21:31:05.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10042024-09-10T21:31:05.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10052024-09-10T21:31:05.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10062024-09-10T21:31:05.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2817, tv_nsec: 297293445 } })
10072024-09-10T21:31:05.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10082024-09-10T21:31:05.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10092024-09-10T21:31:05.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
10102024-09-10T21:31:05.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10112024-09-10T21:31:05.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10122024-09-10T21:31:05.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10132024-09-10T21:31:05.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10142024-09-10T21:31:05.785ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10152024-09-10T21:31:05.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.172932ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10162024-09-10T21:31:05.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10172024-09-10T21:31:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10182024-09-10T21:31:05.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10192024-09-10T21:31:05.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10202024-09-10T21:31:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10212024-09-10T21:31:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10222024-09-10T21:31:05.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10232024-09-10T21:31:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10242024-09-10T21:31:05.807ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
10252024-09-10T21:31:05.807ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10262024-09-10T21:31:05.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10272024-09-10T21:31:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10282024-09-10T21:31:05.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10292024-09-10T21:31:05.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10302024-09-10T21:31:05.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10312024-09-10T21:31:05.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10322024-09-10T21:31:05.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.955067ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
10332024-09-10T21:31:05.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.800692ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10342024-09-10T21:31:05.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10352024-09-10T21:31:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
10362024-09-10T21:31:05.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10372024-09-10T21:31:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10382024-09-10T21:31:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
10392024-09-10T21:31:05.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10402024-09-10T21:31:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10412024-09-10T21:31:05.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10422024-09-10T21:31:05.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10432024-09-10T21:31:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10442024-09-10T21:31:05.813ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.535074ms iteration = 14 status = 0
10452024-09-10T21:31:05.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10462024-09-10T21:31:05.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10472024-09-10T21:31:05.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10482024-09-10T21:31:05.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10492024-09-10T21:31:05.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10502024-09-10T21:31:05.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10512024-09-10T21:31:05.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
10522024-09-10T21:31:05.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.698469ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
10532024-09-10T21:31:05.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.666438ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
10542024-09-10T21:31:05.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10552024-09-10T21:31:05.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10562024-09-10T21:31:05.843ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
10572024-09-10T21:31:05.843ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10582024-09-10T21:31:05.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10592024-09-10T21:31:05.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10602024-09-10T21:31:05.853ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10612024-09-10T21:31:05.853ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10622024-09-10T21:31:05.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.652856ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10632024-09-10T21:31:05.854ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "01ce9f37-3af0-49ec-a443-20ecfb50f1e0", "content-length": "26", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
10642024-09-10T21:31:05.854ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10652024-09-10T21:31:05.855ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10662024-09-10T21:31:05.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10672024-09-10T21:31:05.865ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10682024-09-10T21:31:05.865ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "624b70cb-0d72-4e70-ac10-7e99760f3957", "content-length": "26", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
10692024-09-10T21:31:05.865ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10702024-09-10T21:31:05.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.845407ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10712024-09-10T21:31:05.867ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10722024-09-10T21:31:05.873ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
10732024-09-10T21:31:05.873ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10742024-09-10T21:31:05.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.844269ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
10752024-09-10T21:31:05.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10762024-09-10T21:31:05.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10772024-09-10T21:31:05.881ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
10782024-09-10T21:31:05.881ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10792024-09-10T21:31:05.881ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0cbbf9ed-9aff-4b53-8ce2-2e5c21c88dd7", "content-length": "26", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
10802024-09-10T21:31:05.881ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10812024-09-10T21:31:05.883ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
10822024-09-10T21:31:05.914ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.257171ms iteration = 17 status = {"physical_disks_added":0}
10832024-09-10T21:31:05.950ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10842024-09-10T21:31:05.950ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "52190c75-f3ae-4b5c-9b02-5436802f97b6", "content-length": "1", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
10852024-09-10T21:31:05.952ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10862024-09-10T21:31:05.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10872024-09-10T21:31:05.954ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 190.782599ms iteration = 14 status = null
10882024-09-10T21:31:05.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10892024-09-10T21:31:05.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10902024-09-10T21:31:05.964ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 200.081701ms iteration = 14 status = {}
10912024-09-10T21:31:05.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922024-09-10T21:31:05.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10932024-09-10T21:31:05.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10942024-09-10T21:31:05.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10952024-09-10T21:31:05.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-09-10T21:31:05.967ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10972024-09-10T21:31:05.968ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "94fa6372-f843-4090-83ec-c87ff09ae218", "content-length": "372", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
10982024-09-10T21:31:05.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10992024-09-10T21:31:05.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11002024-09-10T21:31:05.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11012024-09-10T21:31:05.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11022024-09-10T21:31:05.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11032024-09-10T21:31:05.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11042024-09-10T21:31:05.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11052024-09-10T21:31:05.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11062024-09-10T21:31:05.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11072024-09-10T21:31:05.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11082024-09-10T21:31:05.977ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4fbd5307-158f-475f-b3d9-0fdfa8916bc7", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
11092024-09-10T21:31:05.979ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 214.125305ms iteration = 15 status = {}
11102024-09-10T21:31:06.067ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11112024-09-10T21:31:06.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2ae98ae-4da9-47ca-914a-52ad3c3118f8", "content-length": "691", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
11122024-09-10T21:31:06.068ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11132024-09-10T21:31:06.068ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11142024-09-10T21:31:06.068ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11152024-09-10T21:31:06.070ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 305.959918ms iteration = 14 status = {}
11162024-09-10T21:31:06.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11172024-09-10T21:31:06.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11182024-09-10T21:31:06.084ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
11192024-09-10T21:31:06.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11202024-09-10T21:31:06.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11212024-09-10T21:31:06.096ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11222024-09-10T21:31:06.096ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4e8f85f-da53-4b09-9829-72420f171e98", "content-length": "121", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
11232024-09-10T21:31:06.096ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11242024-09-10T21:31:06.096ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
11252024-09-10T21:31:06.096ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11262024-09-10T21:31:06.097ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11272024-09-10T21:31:06.097ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
11282024-09-10T21:31:06.097ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
11292024-09-10T21:31:06.097ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
11302024-09-10T21:31:06.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11312024-09-10T21:31:06.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11322024-09-10T21:31:06.098ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11332024-09-10T21:31:06.100ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "64395dc0-16ce-43af-977d-819256099941", "content-length": "2", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
11342024-09-10T21:31:06.100ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11352024-09-10T21:31:06.102ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ca1237cb-2a2e-4af9-a148-006666d14dec", "content-length": "52", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
11362024-09-10T21:31:06.102ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
11372024-09-10T21:31:06.102ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11382024-09-10T21:31:06.244ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cf1f1fb6-cdc5-45ba-a8ba-ade207466abc", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
11392024-09-10T21:31:06.244ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
11402024-09-10T21:31:06.244ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11412024-09-10T21:31:06.245ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa20ce98-b54c-4746-8bfa-5cae0a0e8b70", "content-length": "667", "date": "Tue, 10 Sep 2024 21:31:05 GMT"} })
11422024-09-10T21:31:06.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11432024-09-10T21:31:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11442024-09-10T21:31:06.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11452024-09-10T21:31:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11462024-09-10T21:31:06.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11472024-09-10T21:31:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11482024-09-10T21:31:06.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11492024-09-10T21:31:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11502024-09-10T21:31:06.263ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 499.876671ms iteration = 14 status = {}
11512024-09-10T21:31:06.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4192a1d4-c881-44f8-ab61-5a9fbcc39cb7 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11522024-09-10T21:31:06.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4192a1d4-c881-44f8-ab61-5a9fbcc39cb7 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11532024-09-10T21:31:06.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4192a1d4-c881-44f8-ab61-5a9fbcc39cb7 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11542024-09-10T21:31:06.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 5b6ccde5-105e-40be-a536-67d8ad7f97fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
11552024-09-10T21:31:06.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 5b6ccde5-105e-40be-a536-67d8ad7f97fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
11562024-09-10T21:31:06.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 5b6ccde5-105e-40be-a536-67d8ad7f97fa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
11572024-09-10T21:31:07.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 42c928c9-f33a-476e-9446-7233514c50b9 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11582024-09-10T21:31:07.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 42c928c9-f33a-476e-9446-7233514c50b9 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11592024-09-10T21:31:07.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 42c928c9-f33a-476e-9446-7233514c50b9 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11602024-09-10T21:31:08.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cabec06c-a752-4939-a800-7e669853a7b5 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11612024-09-10T21:31:08.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cabec06c-a752-4939-a800-7e669853a7b5 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11622024-09-10T21:31:08.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cabec06c-a752-4939-a800-7e669853a7b5 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11632024-09-10T21:31:08.857ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 8f387020-0056-4e41-8778-a07ff95e280c response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
11642024-09-10T21:31:09.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 31ed8096-6d49-486f-9e62-5e2d4b832596 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11652024-09-10T21:31:09.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 31ed8096-6d49-486f-9e62-5e2d4b832596 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11662024-09-10T21:31:09.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 31ed8096-6d49-486f-9e62-5e2d4b832596 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11672024-09-10T21:31:10.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fd6c0c31-b4db-4da5-987e-e530ee2766f3 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11682024-09-10T21:31:10.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fd6c0c31-b4db-4da5-987e-e530ee2766f3 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11692024-09-10T21:31:10.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fd6c0c31-b4db-4da5-987e-e530ee2766f3 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11702024-09-10T21:31:11.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f4d4559e-2e00-48f9-9bac-6b444ac4c48b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11712024-09-10T21:31:11.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f4d4559e-2e00-48f9-9bac-6b444ac4c48b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11722024-09-10T21:31:11.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f4d4559e-2e00-48f9-9bac-6b444ac4c48b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11732024-09-10T21:31:12.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 578cd48a-0f40-4b6f-85b4-00277fcf1b4b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11742024-09-10T21:31:12.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 578cd48a-0f40-4b6f-85b4-00277fcf1b4b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11752024-09-10T21:31:12.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 578cd48a-0f40-4b6f-85b4-00277fcf1b4b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11762024-09-10T21:31:13.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5b50edd1-53aa-4370-b9e3-ecca91f56ebb roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11772024-09-10T21:31:13.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5b50edd1-53aa-4370-b9e3-ecca91f56ebb resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11782024-09-10T21:31:13.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5b50edd1-53aa-4370-b9e3-ecca91f56ebb response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11792024-09-10T21:31:14.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b2e87511-15e5-4e80-b3aa-f1786f0e71c0 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11802024-09-10T21:31:14.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b2e87511-15e5-4e80-b3aa-f1786f0e71c0 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11812024-09-10T21:31:14.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b2e87511-15e5-4e80-b3aa-f1786f0e71c0 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11822024-09-10T21:31:15.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 06a22a79-e21d-4c36-bb0d-811d9957f0bc roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11832024-09-10T21:31:15.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 06a22a79-e21d-4c36-bb0d-811d9957f0bc resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11842024-09-10T21:31:15.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 06a22a79-e21d-4c36-bb0d-811d9957f0bc response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
11852024-09-10T21:31:15.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
11862024-09-10T21:31:15.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11872024-09-10T21:31:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11882024-09-10T21:31:15.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
11892024-09-10T21:31:15.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11902024-09-10T21:31:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11912024-09-10T21:31:15.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922024-09-10T21:31:15.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11932024-09-10T21:31:15.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11942024-09-10T21:31:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11952024-09-10T21:31:15.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11962024-09-10T21:31:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11972024-09-10T21:31:15.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11982024-09-10T21:31:15.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11992024-09-10T21:31:15.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002024-09-10T21:31:15.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
12012024-09-10T21:31:15.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12022024-09-10T21:31:15.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12032024-09-10T21:31:15.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
12042024-09-10T21:31:15.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.541753ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
12052024-09-10T21:31:15.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.474831ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12062024-09-10T21:31:16.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4cc3be13-fb6d-455a-bf9e-521601bfc4cd roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12072024-09-10T21:31:16.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4cc3be13-fb6d-455a-bf9e-521601bfc4cd resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12082024-09-10T21:31:16.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 4cc3be13-fb6d-455a-bf9e-521601bfc4cd response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12092024-09-10T21:31:17.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 617ccc9e-d531-4d67-87da-0a36ba0ba14a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12102024-09-10T21:31:17.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 617ccc9e-d531-4d67-87da-0a36ba0ba14a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12112024-09-10T21:31:17.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 617ccc9e-d531-4d67-87da-0a36ba0ba14a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12122024-09-10T21:31:17.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = be05e0f6-dfd6-496b-9eaa-27d7bfc040e4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
12132024-09-10T21:31:17.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = be05e0f6-dfd6-496b-9eaa-27d7bfc040e4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
12142024-09-10T21:31:17.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = be05e0f6-dfd6-496b-9eaa-27d7bfc040e4 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
12152024-09-10T21:31:17.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b3391d00-f87f-435e-aa44-321b3e31155b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12162024-09-10T21:31:17.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b3391d00-f87f-435e-aa44-321b3e31155b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12172024-09-10T21:31:17.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b3391d00-f87f-435e-aa44-321b3e31155b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12182024-09-10T21:31:18.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 29ceb89f-5ed2-4703-9095-69b4246d2565 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12192024-09-10T21:31:18.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 29ceb89f-5ed2-4703-9095-69b4246d2565 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12202024-09-10T21:31:18.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 29ceb89f-5ed2-4703-9095-69b4246d2565 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12212024-09-10T21:31:18.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1358 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 9db89fcb-723b-4d6f-8c24-0a93061077c4 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
12222024-09-10T21:31:19.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5ae04fc3-85a7-430e-a377-80288646b2c0 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12232024-09-10T21:31:19.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5ae04fc3-85a7-430e-a377-80288646b2c0 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12242024-09-10T21:31:19.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5ae04fc3-85a7-430e-a377-80288646b2c0 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12252024-09-10T21:31:20.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f2482fc9-161e-44b6-a4b8-10c6701924a2 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12262024-09-10T21:31:20.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f2482fc9-161e-44b6-a4b8-10c6701924a2 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12272024-09-10T21:31:20.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f2482fc9-161e-44b6-a4b8-10c6701924a2 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12282024-09-10T21:31:21.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0812be25-4214-4d9a-a9a8-1f9d4e46ba62 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12292024-09-10T21:31:21.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0812be25-4214-4d9a-a9a8-1f9d4e46ba62 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12302024-09-10T21:31:21.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0812be25-4214-4d9a-a9a8-1f9d4e46ba62 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12312024-09-10T21:31:22.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2259261d-75f1-43d9-8686-0857ba6b4f07 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12322024-09-10T21:31:22.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2259261d-75f1-43d9-8686-0857ba6b4f07 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12332024-09-10T21:31:22.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2259261d-75f1-43d9-8686-0857ba6b4f07 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12342024-09-10T21:31:23.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9212f435-6f09-4814-98d7-ececb25718a1 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12352024-09-10T21:31:23.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9212f435-6f09-4814-98d7-ececb25718a1 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12362024-09-10T21:31:23.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9212f435-6f09-4814-98d7-ececb25718a1 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12372024-09-10T21:31:24.808ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6b8f86ab-beb7-475e-a8e8-fae535168328 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-10T21:31:24.807777026Z }
12382024-09-10T21:31:24.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6b8f86ab-beb7-475e-a8e8-fae535168328 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
12392024-09-10T21:31:24.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6b8f86ab-beb7-475e-a8e8-fae535168328 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
12402024-09-10T21:31:24.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 16188 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6b8f86ab-beb7-475e-a8e8-fae535168328 response_code = 204 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
12412024-09-10T21:31:24.845ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:41747
12422024-09-10T21:31:24.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:41747 req_id = 5299e6f1-de4b-45d3-8d75-62c0c83c0cd1 roles = RoleSet { roles: {} } uri = /metrics/producers
12432024-09-10T21:31:24.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:41747 req_id = 5299e6f1-de4b-45d3-8d75-62c0c83c0cd1 resource = Database result = Ok(()) uri = /metrics/producers
12442024-09-10T21:31:24.847ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 49b82bb9-bacf-4a3a-826c-3574b6fa992f uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-10T21:31:24.847411307Z }
12452024-09-10T21:31:24.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 49b82bb9-bacf-4a3a-826c-3574b6fa992f roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
12462024-09-10T21:31:24.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 49b82bb9-bacf-4a3a-826c-3574b6fa992f resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
12472024-09-10T21:31:24.880ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
12482024-09-10T21:31:24.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:41747 req_id = 5299e6f1-de4b-45d3-8d75-62c0c83c0cd1 roles = RoleSet { roles: {} } uri = /metrics/producers
12492024-09-10T21:31:24.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:41747 req_id = 5299e6f1-de4b-45d3-8d75-62c0c83c0cd1 resource = Database result = Ok(()) uri = /metrics/producers
12502024-09-10T21:31:24.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 35221 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 49b82bb9-bacf-4a3a-826c-3574b6fa992f response_code = 204 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
12512024-09-10T21:31:24.911ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
12522024-09-10T21:31:24.911ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ec9c08a1-44ed-4ae6-adc5-f578ea7c1505", "date": "Tue, 10 Sep 2024 21:31:24 GMT"} })
12532024-09-10T21:31:24.911ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 53ccff73-54b9-4394-92ab-a634606c67a5
12542024-09-10T21:31:24.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 67596 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:41747 req_id = 5299e6f1-de4b-45d3-8d75-62c0c83c0cd1 response_code = 201 uri = /metrics/producers
12552024-09-10T21:31:24.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 960b5994-6e4c-4c27-af80-e996fc6a19a7 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12562024-09-10T21:31:24.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 960b5994-6e4c-4c27-af80-e996fc6a19a7 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12572024-09-10T21:31:24.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 960b5994-6e4c-4c27-af80-e996fc6a19a7 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12582024-09-10T21:31:25.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
12592024-09-10T21:31:25.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12602024-09-10T21:31:25.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12612024-09-10T21:31:25.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
12622024-09-10T21:31:25.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12632024-09-10T21:31:25.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12642024-09-10T21:31:25.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12652024-09-10T21:31:25.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12662024-09-10T21:31:25.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12672024-09-10T21:31:25.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12682024-09-10T21:31:25.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12692024-09-10T21:31:25.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12702024-09-10T21:31:25.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.200053ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12712024-09-10T21:31:25.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12722024-09-10T21:31:25.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12732024-09-10T21:31:25.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12742024-09-10T21:31:25.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
12752024-09-10T21:31:25.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12762024-09-10T21:31:25.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12772024-09-10T21:31:25.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
12782024-09-10T21:31:25.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.36446ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
12792024-09-10T21:31:25.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2d1f9cf5-8cdb-4464-b864-a901fa2e024c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12802024-09-10T21:31:25.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2d1f9cf5-8cdb-4464-b864-a901fa2e024c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12812024-09-10T21:31:25.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2d1f9cf5-8cdb-4464-b864-a901fa2e024c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12822024-09-10T21:31:27.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e5b4ea72-3755-4d61-a4a9-12cdcee6e4f7 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12832024-09-10T21:31:27.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e5b4ea72-3755-4d61-a4a9-12cdcee6e4f7 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12842024-09-10T21:31:27.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e5b4ea72-3755-4d61-a4a9-12cdcee6e4f7 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12852024-09-10T21:31:28.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb8dd0c8-691b-41c9-b3b7-dc9f2f1b2dc1 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12862024-09-10T21:31:28.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb8dd0c8-691b-41c9-b3b7-dc9f2f1b2dc1 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12872024-09-10T21:31:28.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb8dd0c8-691b-41c9-b3b7-dc9f2f1b2dc1 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12882024-09-10T21:31:28.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1406 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 6439a358-0d47-4e19-b8a6-2d13b42c300e response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
12892024-09-10T21:31:29.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 57d1e2fa-e525-4f47-be8b-a95659721cfb roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12902024-09-10T21:31:29.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 57d1e2fa-e525-4f47-be8b-a95659721cfb resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12912024-09-10T21:31:29.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 57d1e2fa-e525-4f47-be8b-a95659721cfb response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12922024-09-10T21:31:30.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e4ec6ebc-c1a5-4570-b6f0-beed3ca2d4b6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12932024-09-10T21:31:30.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e4ec6ebc-c1a5-4570-b6f0-beed3ca2d4b6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12942024-09-10T21:31:30.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e4ec6ebc-c1a5-4570-b6f0-beed3ca2d4b6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12952024-09-10T21:31:31.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a88c6fec-2af7-40fa-bbf2-e233999a10dc roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12962024-09-10T21:31:31.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a88c6fec-2af7-40fa-bbf2-e233999a10dc resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12972024-09-10T21:31:31.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a88c6fec-2af7-40fa-bbf2-e233999a10dc response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12982024-09-10T21:31:32.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c44a65a-9a03-4eb0-90ae-a3206303ab71 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
12992024-09-10T21:31:32.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c44a65a-9a03-4eb0-90ae-a3206303ab71 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13002024-09-10T21:31:32.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c44a65a-9a03-4eb0-90ae-a3206303ab71 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13012024-09-10T21:31:33.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 904a971c-8a5a-4636-9b49-70952b0e174d roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13022024-09-10T21:31:33.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 904a971c-8a5a-4636-9b49-70952b0e174d resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13032024-09-10T21:31:33.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 904a971c-8a5a-4636-9b49-70952b0e174d response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13042024-09-10T21:31:34.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1c9d7e19-cef8-4e9a-9020-456d6b33bae6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13052024-09-10T21:31:34.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1c9d7e19-cef8-4e9a-9020-456d6b33bae6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13062024-09-10T21:31:34.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1c9d7e19-cef8-4e9a-9020-456d6b33bae6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13072024-09-10T21:31:35.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 630308d7-a224-46a8-aede-1485ced02ed6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13082024-09-10T21:31:35.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 630308d7-a224-46a8-aede-1485ced02ed6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13092024-09-10T21:31:35.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 630308d7-a224-46a8-aede-1485ced02ed6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
13102024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
13112024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
13122024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13132024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13142024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
13152024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13162024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
13172024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
13182024-09-10T21:31:35.764ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-10 21:21:35.764167513 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13192024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13202024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
13212024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
13222024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13232024-09-10T21:31:35.764ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f
13242024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.311\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f"}
13252024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
13262024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13272024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
13282024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13292024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13302024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
13312024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13322024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
13332024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
13342024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
13352024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13362024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
13372024-09-10T21:31:35.764ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13382024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
13392024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13402024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13412024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
13422024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13432024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
13442024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
13452024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
13462024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13472024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13482024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
13492024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13502024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
13512024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13522024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
13532024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
13542024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13552024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
13562024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13572024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13582024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
13592024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13602024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13612024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
13622024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
13632024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13642024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13652024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
13662024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13672024-09-10T21:31:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13682024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
13692024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13702024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13712024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13722024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13732024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13742024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13752024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13762024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13772024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13782024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13792024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13802024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
13812024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13822024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13832024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
13842024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13852024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13862024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13872024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13882024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13892024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13902024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13912024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13922024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13932024-09-10T21:31:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13942024-09-10T21:31:35.766ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22ec8121-6583-4054-9535-d2454e5c4dec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2847, tv_nsec: 283477894 } })
13952024-09-10T21:31:35.766ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48d3ebb5-3dc4-4b69-a505-4bb07f9482ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94337c1c-5cb5-4050-bd90-d4c50dd633f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2847, tv_nsec: 283632197 } })
13962024-09-10T21:31:35.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13972024-09-10T21:31:35.767ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
13982024-09-10T21:31:35.767ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.025453ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
13992024-09-10T21:31:35.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002024-09-10T21:31:35.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14012024-09-10T21:31:35.768ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
14022024-09-10T21:31:35.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.794556ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
14032024-09-10T21:31:35.768ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-10 21:21:35.764167513 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14042024-09-10T21:31:35.768ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.62164ms iteration = 8 status = {"expiration":"2024-09-10T21:21:35.764167513Z","pruned":[]}
14052024-09-10T21:31:35.769ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.929836ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14062024-09-10T21:31:35.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14072024-09-10T21:31:35.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14082024-09-10T21:31:35.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092024-09-10T21:31:35.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14102024-09-10T21:31:35.770ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2847, tv_nsec: 287859380 } })
14112024-09-10T21:31:35.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14122024-09-10T21:31:35.771ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
14132024-09-10T21:31:35.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14142024-09-10T21:31:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14152024-09-10T21:31:35.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14162024-09-10T21:31:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14172024-09-10T21:31:35.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14182024-09-10T21:31:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14192024-09-10T21:31:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14202024-09-10T21:31:35.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14212024-09-10T21:31:35.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14222024-09-10T21:31:35.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14232024-09-10T21:31:35.775ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14242024-09-10T21:31:35.775ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14252024-09-10T21:31:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14262024-09-10T21:31:35.776ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14272024-09-10T21:31:35.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14282024-09-10T21:31:35.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14292024-09-10T21:31:35.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14302024-09-10T21:31:35.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14312024-09-10T21:31:35.781ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.410074ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
14322024-09-10T21:31:35.782ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2847, tv_nsec: 299527374 } })
14332024-09-10T21:31:35.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
14342024-09-10T21:31:35.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14352024-09-10T21:31:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14362024-09-10T21:31:35.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-09-10T21:31:35.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14382024-09-10T21:31:35.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14392024-09-10T21:31:35.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14402024-09-10T21:31:35.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14412024-09-10T21:31:35.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14422024-09-10T21:31:35.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14432024-09-10T21:31:35.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14442024-09-10T21:31:35.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2847, tv_nsec: 318886882 } })
14452024-09-10T21:31:35.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
14462024-09-10T21:31:35.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472024-09-10T21:31:35.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14482024-09-10T21:31:35.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14492024-09-10T21:31:35.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14502024-09-10T21:31:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14512024-09-10T21:31:35.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14522024-09-10T21:31:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14532024-09-10T21:31:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
14542024-09-10T21:31:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14552024-09-10T21:31:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14562024-09-10T21:31:35.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14572024-09-10T21:31:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14582024-09-10T21:31:35.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14592024-09-10T21:31:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14602024-09-10T21:31:35.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14612024-09-10T21:31:35.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.805336ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
14622024-09-10T21:31:35.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14632024-09-10T21:31:35.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14642024-09-10T21:31:35.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14652024-09-10T21:31:35.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
14662024-09-10T21:31:35.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.833447ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
14672024-09-10T21:31:35.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.081092ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
14682024-09-10T21:31:35.820ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
14692024-09-10T21:31:35.820ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14702024-09-10T21:31:35.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14712024-09-10T21:31:35.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14722024-09-10T21:31:35.830ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14732024-09-10T21:31:35.830ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14742024-09-10T21:31:35.830ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.637215ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14752024-09-10T21:31:35.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762024-09-10T21:31:35.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14772024-09-10T21:31:35.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14782024-09-10T21:31:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14792024-09-10T21:31:35.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14802024-09-10T21:31:35.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14812024-09-10T21:31:35.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14822024-09-10T21:31:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14832024-09-10T21:31:35.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14842024-09-10T21:31:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14852024-09-10T21:31:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14862024-09-10T21:31:35.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14872024-09-10T21:31:35.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.674623ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
14882024-09-10T21:31:35.837ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14892024-09-10T21:31:35.837ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
14902024-09-10T21:31:35.837ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.253578ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
14912024-09-10T21:31:35.839ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14922024-09-10T21:31:35.839ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14932024-09-10T21:31:35.839ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14942024-09-10T21:31:35.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14952024-09-10T21:31:35.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14962024-09-10T21:31:35.845ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 81.049434ms iteration = 18 status = {"physical_disks_added":0}
14972024-09-10T21:31:35.861ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14982024-09-10T21:31:35.861ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14992024-09-10T21:31:35.861ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15002024-09-10T21:31:35.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15012024-09-10T21:31:35.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15022024-09-10T21:31:35.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15032024-09-10T21:31:35.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15042024-09-10T21:31:35.899ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15052024-09-10T21:31:35.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
15062024-09-10T21:31:35.925ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15072024-09-10T21:31:35.925ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f0998b46-804f-46c0-8678-ff1c80520b0f", "content-length": "26", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
15082024-09-10T21:31:35.925ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15092024-09-10T21:31:35.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
15102024-09-10T21:31:35.927ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15112024-09-10T21:31:35.927ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15122024-09-10T21:31:35.927ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "443172c6-7e92-41cb-a272-86eed131743e", "content-length": "26", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
15132024-09-10T21:31:35.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15142024-09-10T21:31:35.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15152024-09-10T21:31:35.965ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/12a57104-3b71-45c4-bbff-e90aa18443a8/state
15162024-09-10T21:31:35.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/12a57104-3b71-45c4-bbff-e90aa18443a8/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4eb67df3-599d-4c19-924e-c3a1800e46d8", "content-length": "130", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
15172024-09-10T21:31:35.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15182024-09-10T21:31:35.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15192024-09-10T21:31:35.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15202024-09-10T21:31:35.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 204.231173ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15212024-09-10T21:31:35.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15222024-09-10T21:31:35.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232024-09-10T21:31:35.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15242024-09-10T21:31:35.972ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 sled_id = 403254df-bc94-46d0-9b33-45b17d93603a state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-10T21:31:24.847411307Z }, migration_in: None, migration_out: None } vmm_id = 12a57104-3b71-45c4-bbff-e90aa18443a8
15252024-09-10T21:31:35.972ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1984 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 sled_id = 403254df-bc94-46d0-9b33-45b17d93603a vmm_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-10T21:31:24.847411307Z }
15262024-09-10T21:31:35.972ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 roles = RoleSet { roles: {} } sled_id = 403254df-bc94-46d0-9b33-45b17d93603a vmm_id = 12a57104-3b71-45c4-bbff-e90aa18443a8
15272024-09-10T21:31:35.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 resource = Database result = Ok(()) sled_id = 403254df-bc94-46d0-9b33-45b17d93603a vmm_id = 12a57104-3b71-45c4-bbff-e90aa18443a8
15282024-09-10T21:31:35.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15292024-09-10T21:31:35.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15302024-09-10T21:31:35.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15312024-09-10T21:31:35.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15322024-09-10T21:31:35.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15332024-09-10T21:31:35.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15342024-09-10T21:31:35.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15352024-09-10T21:31:35.977ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15362024-09-10T21:31:35.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15372024-09-10T21:31:35.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15382024-09-10T21:31:36.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15392024-09-10T21:31:36.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15402024-09-10T21:31:36.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15412024-09-10T21:31:36.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15422024-09-10T21:31:36.006ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15432024-09-10T21:31:36.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15442024-09-10T21:31:36.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 244.823171ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15452024-09-10T21:31:36.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-09-10T21:31:36.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-09-10T21:31:36.010ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15482024-09-10T21:31:36.010ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15492024-09-10T21:31:36.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15502024-09-10T21:31:36.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15512024-09-10T21:31:36.011ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
15522024-09-10T21:31:36.011ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15532024-09-10T21:31:36.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15542024-09-10T21:31:36.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15552024-09-10T21:31:36.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15562024-09-10T21:31:36.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15572024-09-10T21:31:36.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15582024-09-10T21:31:36.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15592024-09-10T21:31:36.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15602024-09-10T21:31:36.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15612024-09-10T21:31:36.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15622024-09-10T21:31:36.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15632024-09-10T21:31:36.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15642024-09-10T21:31:36.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15652024-09-10T21:31:36.017ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15662024-09-10T21:31:36.033ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
15672024-09-10T21:31:36.035ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 270.734343ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
15682024-09-10T21:31:36.047ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-10T21:24:32.656983Z, time_modified: 2024-09-10T21:24:32.656983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
15692024-09-10T21:31:36.047ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 283.025868ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]}},"default_endpoint":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15702024-09-10T21:31:36.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-09-10T21:31:36.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
15722024-09-10T21:31:36.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15732024-09-10T21:31:36.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15742024-09-10T21:31:36.069ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
15752024-09-10T21:31:36.069ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15762024-09-10T21:31:36.069ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 304.98053ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
15772024-09-10T21:31:36.070ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15782024-09-10T21:31:36.070ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 0 version = 2
15792024-09-10T21:31:36.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15802024-09-10T21:31:36.071ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 306.970555ms iteration = 15 status = 0
15812024-09-10T21:31:36.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15822024-09-10T21:31:36.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15832024-09-10T21:31:36.073ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15842024-09-10T21:31:36.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852024-09-10T21:31:36.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 310.149611ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15862024-09-10T21:31:36.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15872024-09-10T21:31:36.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15882024-09-10T21:31:36.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15892024-09-10T21:31:36.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15902024-09-10T21:31:36.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15912024-09-10T21:31:36.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15922024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
15932024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15942024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-10 21:24:36.002618 UTC dns_group = internal generation = 1
15952024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 313.926787ms iteration = 9 status = {"generation":1}
15962024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 1 version = 2
15972024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15982024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-10 21:24:37.242901 UTC dns_group = external generation = 2
15992024-09-10T21:31:36.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 314.745591ms iteration = 9 status = {"generation":2}
16002024-09-10T21:31:36.082ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
16012024-09-10T21:31:36.082ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16022024-09-10T21:31:36.082ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77d08016-e8f2-4ab0-b744-3e3bcabdcf36", "content-length": "26", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
16032024-09-10T21:31:36.082ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16042024-09-10T21:31:36.083ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16052024-09-10T21:31:36.084ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c3731ba2-4576-48b1-8d69-f309adc6955e", "content-length": "1", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
16062024-09-10T21:31:36.085ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
16072024-09-10T21:31:36.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16082024-09-10T21:31:36.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16092024-09-10T21:31:36.094ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 330.060748ms iteration = 15 status = null
16102024-09-10T21:31:36.095ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 331.468403ms iteration = 15 status = {}
16112024-09-10T21:31:36.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = bb812c1d-a7d2-48f3-ac32-4c331699cdf9 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
16122024-09-10T21:31:36.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = bb812c1d-a7d2-48f3-ac32-4c331699cdf9 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
16132024-09-10T21:31:36.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16142024-09-10T21:31:36.215ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "db9a5d9c-6b3e-4715-8d56-3231981d6cf6", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16152024-09-10T21:31:36.215ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16162024-09-10T21:31:36.217ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "484a8861-33d2-4f4a-8bc6-f6662ea5a194", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16172024-09-10T21:31:36.217ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16182024-09-10T21:31:36.218ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16192024-09-10T21:31:36.218ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 454.444498ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16202024-09-10T21:31:36.231ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16212024-09-10T21:31:36.233ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4d3c06d4-3a10-423d-a0b3-f0eb47a40c49", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16222024-09-10T21:31:36.233ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16232024-09-10T21:31:36.235ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "671690c0-62bb-409d-9bae-134e215b42cf", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16242024-09-10T21:31:36.235ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16252024-09-10T21:31:36.237ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "095cfb4c-7a54-4d2a-bc76-4816c54d766d", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16262024-09-10T21:31:36.237ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16272024-09-10T21:31:36.239ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16282024-09-10T21:31:36.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 475.082209ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16292024-09-10T21:31:36.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16302024-09-10T21:31:36.256ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d146003-2a61-4203-8e55-9f342eb67220", "content-length": "525", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} })
16312024-09-10T21:31:36.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16322024-09-10T21:31:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16332024-09-10T21:31:36.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = bb812c1d-a7d2-48f3-ac32-4c331699cdf9 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
16342024-09-10T21:31:36.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16352024-09-10T21:31:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16362024-09-10T21:31:36.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16372024-09-10T21:31:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16382024-09-10T21:31:36.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16392024-09-10T21:31:36.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16402024-09-10T21:31:36.310ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16412024-09-10T21:31:36.311ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c94f3d40-950a-4b56-be5a-92e8d8d9ab3b", "content-length": "811", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} })
16422024-09-10T21:31:36.311ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 98, 200])), vni: Vni(13144484) }} sled = sock
16432024-09-10T21:31:36.311ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16442024-09-10T21:31:36.311ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16452024-09-10T21:31:36.312ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 548.308046ms iteration = 15 status = {}
16462024-09-10T21:31:36.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16472024-09-10T21:31:36.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16482024-09-10T21:31:36.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16492024-09-10T21:31:36.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16502024-09-10T21:31:36.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16512024-09-10T21:31:36.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16522024-09-10T21:31:36.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16532024-09-10T21:31:36.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16542024-09-10T21:31:36.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16552024-09-10T21:31:36.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16562024-09-10T21:31:36.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16572024-09-10T21:31:36.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16582024-09-10T21:31:36.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16592024-09-10T21:31:36.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16602024-09-10T21:31:36.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16612024-09-10T21:31:36.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16622024-09-10T21:31:36.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16632024-09-10T21:31:36.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16642024-09-10T21:31:36.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652024-09-10T21:31:36.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, lookup_type: ById(644a396e-dfc8-46ce-bf81-7b188fb4c5ae) }, key: 448f551c-01bd-448a-b11d-bb2152f07888, lookup_type: ById(448f551c-01bd-448a-b11d-bb2152f07888) }, key: d708d047-6171-4b5b-a84f-743334980a73, lookup_type: ById(d708d047-6171-4b5b-a84f-743334980a73) }, key: 1e1a49f5-5e73-4f04-ab78-4f4853f56e47, lookup_type: ById(1e1a49f5-5e73-4f04-ab78-4f4853f56e47) } result = Ok(())
16662024-09-10T21:31:36.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16672024-09-10T21:31:36.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16682024-09-10T21:31:36.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16692024-09-10T21:31:36.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16702024-09-10T21:31:36.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16712024-09-10T21:31:36.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16722024-09-10T21:31:36.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16732024-09-10T21:31:36.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16742024-09-10T21:31:36.377ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
16752024-09-10T21:31:36.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16762024-09-10T21:31:36.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16772024-09-10T21:31:36.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16782024-09-10T21:31:36.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, lookup_type: ById(644a396e-dfc8-46ce-bf81-7b188fb4c5ae) }, key: 448f551c-01bd-448a-b11d-bb2152f07888, lookup_type: ById(448f551c-01bd-448a-b11d-bb2152f07888) }, key: d708d047-6171-4b5b-a84f-743334980a73, lookup_type: ById(d708d047-6171-4b5b-a84f-743334980a73) }, key: 1e1a49f5-5e73-4f04-ab78-4f4853f56e47, lookup_type: ById(1e1a49f5-5e73-4f04-ab78-4f4853f56e47) } result = Ok(())
16792024-09-10T21:31:36.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16802024-09-10T21:31:36.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16812024-09-10T21:31:36.386ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16822024-09-10T21:31:36.386ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19d8dd97-99f7-49ee-8bea-b680c2140a17", "content-length": "121", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
16832024-09-10T21:31:36.386ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16842024-09-10T21:31:36.386ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
16852024-09-10T21:31:36.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16862024-09-10T21:31:36.387ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16872024-09-10T21:31:36.387ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16882024-09-10T21:31:36.387ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
16892024-09-10T21:31:36.387ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
16902024-09-10T21:31:36.387ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
16912024-09-10T21:31:36.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16922024-09-10T21:31:36.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16932024-09-10T21:31:36.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16942024-09-10T21:31:36.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16952024-09-10T21:31:36.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16962024-09-10T21:31:36.389ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16972024-09-10T21:31:36.389ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45b3f494-eb32-4b0f-8a0b-f388a75ef3d6", "content-length": "2", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
16982024-09-10T21:31:36.389ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16992024-09-10T21:31:36.391ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5bc495d8-edc6-428d-bf50-e3c729afdadb", "content-length": "52", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
17002024-09-10T21:31:36.391ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
17012024-09-10T21:31:36.391ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17022024-09-10T21:31:36.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17032024-09-10T21:31:36.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17042024-09-10T21:31:36.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17052024-09-10T21:31:36.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17062024-09-10T21:31:36.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17072024-09-10T21:31:36.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17082024-09-10T21:31:36.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17092024-09-10T21:31:36.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17102024-09-10T21:31:36.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17112024-09-10T21:31:36.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17122024-09-10T21:31:36.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132024-09-10T21:31:36.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, lookup_type: ById(644a396e-dfc8-46ce-bf81-7b188fb4c5ae) }, key: 448f551c-01bd-448a-b11d-bb2152f07888, lookup_type: ById(448f551c-01bd-448a-b11d-bb2152f07888) }, key: d708d047-6171-4b5b-a84f-743334980a73, lookup_type: ById(d708d047-6171-4b5b-a84f-743334980a73) }, key: 0703e5c6-b761-451d-844f-081405f21d9a, lookup_type: ByName("default") } result = Ok(())
17142024-09-10T21:31:36.404ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17152024-09-10T21:31:36.488ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9137a0d6-a805-4e35-a7e3-232696b08e31", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
17162024-09-10T21:31:36.488ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
17172024-09-10T21:31:36.488ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17182024-09-10T21:31:36.488ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d77081e3-bdb8-4469-9117-0406f6ddc16b", "content-length": "667", "date": "Tue, 10 Sep 2024 21:31:35 GMT"} })
17192024-09-10T21:31:36.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17202024-09-10T21:31:36.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17212024-09-10T21:31:36.489ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2d9cac0f-408a-40c5-8327-f147bfad6738", "date": "Tue, 10 Sep 2024 21:31:36 GMT"} })
17222024-09-10T21:31:36.491ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 726.806231ms iteration = 16 status = {}
17232024-09-10T21:31:36.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17242024-09-10T21:31:36.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17252024-09-10T21:31:36.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17262024-09-10T21:31:36.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17272024-09-10T21:31:36.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17282024-09-10T21:31:36.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17292024-09-10T21:31:36.505ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 741.700381ms iteration = 15 status = {}
17302024-09-10T21:31:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3d0cf567-c9a6-4268-b889-f7620f63f04b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17312024-09-10T21:31:37.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3d0cf567-c9a6-4268-b889-f7620f63f04b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17322024-09-10T21:31:37.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3d0cf567-c9a6-4268-b889-f7620f63f04b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17332024-09-10T21:31:37.966ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b5bfe899-adce-4297-afac-0e7dbd1e9d5b uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-10T21:31:37.965275677Z }
17342024-09-10T21:31:37.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b5bfe899-adce-4297-afac-0e7dbd1e9d5b roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17352024-09-10T21:31:37.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b5bfe899-adce-4297-afac-0e7dbd1e9d5b resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17362024-09-10T21:31:38.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38421 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b5bfe899-adce-4297-afac-0e7dbd1e9d5b response_code = 204 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17372024-09-10T21:31:38.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d27dacf-7e5c-4630-8565-cbf1199495fd roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17382024-09-10T21:31:38.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d27dacf-7e5c-4630-8565-cbf1199495fd resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17392024-09-10T21:31:38.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d27dacf-7e5c-4630-8565-cbf1199495fd response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17402024-09-10T21:31:38.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = d6e50d71-9c55-4abc-92f7-77e3285b6811 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
17412024-09-10T21:31:38.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = d6e50d71-9c55-4abc-92f7-77e3285b6811 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
17422024-09-10T21:31:38.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = d6e50d71-9c55-4abc-92f7-77e3285b6811 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
17432024-09-10T21:31:38.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = dad594d7-d08a-457c-8d8e-9ba73c61f317 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
17442024-09-10T21:31:38.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = dad594d7-d08a-457c-8d8e-9ba73c61f317 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
17452024-09-10T21:31:38.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = dad594d7-d08a-457c-8d8e-9ba73c61f317 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
17462024-09-10T21:31:38.857ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = d748d922-8df0-467c-af13-672fda66a05d response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
17472024-09-10T21:31:39.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0d06c93e-aa1f-46ee-a773-65c7f44374cd roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17482024-09-10T21:31:39.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0d06c93e-aa1f-46ee-a773-65c7f44374cd resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17492024-09-10T21:31:39.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0d06c93e-aa1f-46ee-a773-65c7f44374cd response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17502024-09-10T21:31:39.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 189abd97-2d47-4fbe-aeba-5353c46ee96b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
17512024-09-10T21:31:39.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 189abd97-2d47-4fbe-aeba-5353c46ee96b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
17522024-09-10T21:31:39.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 189abd97-2d47-4fbe-aeba-5353c46ee96b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
17532024-09-10T21:31:40.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1a4ecf36-94a8-4dfa-a852-c7009b15bf64 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17542024-09-10T21:31:40.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1a4ecf36-94a8-4dfa-a852-c7009b15bf64 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17552024-09-10T21:31:40.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1a4ecf36-94a8-4dfa-a852-c7009b15bf64 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
17562024-09-10T21:31:40.378ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-10T21:31:40.378517914Z }
17572024-09-10T21:31:40.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17582024-09-10T21:31:40.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17592024-09-10T21:31:40.418ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_needs_update = true
17602024-09-10T21:31:40.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17612024-09-10T21:31:40.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17622024-09-10T21:31:40.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17632024-09-10T21:31:40.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17642024-09-10T21:31:40.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17652024-09-10T21:31:40.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17662024-09-10T21:31:40.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17672024-09-10T21:31:40.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17682024-09-10T21:31:40.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17692024-09-10T21:31:40.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17702024-09-10T21:31:40.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17712024-09-10T21:31:40.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17722024-09-10T21:31:40.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17732024-09-10T21:31:40.433ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, lookup_type: ById(644a396e-dfc8-46ce-bf81-7b188fb4c5ae) }, key: 448f551c-01bd-448a-b11d-bb2152f07888, lookup_type: ById(448f551c-01bd-448a-b11d-bb2152f07888) }, key: 53ccff73-54b9-4394-92ab-a634606c67a5, lookup_type: ById(53ccff73-54b9-4394-92ab-a634606c67a5) } result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17742024-09-10T21:31:40.436ZINFOnexus (dropshot_internal): starting update saga for 53ccff73-54b9-4394-92ab-a634606c67a5 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1459 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-10T21:31:40.378517914Z }
17752024-09-10T21:31:40.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 57645 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 response_code = 204 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17762024-09-10T21:31:40.436ZDEBGnexus (dropshot_internal): preparing instance-update saga for 53ccff73-54b9-4394-92ab-a634606c67a5... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 801cf546-145a-444c-9002-a0f0ce628ae9 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17772024-09-10T21:31:40.436ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6bef7de0-10a2-40f3-a3e0-24be34732806 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-10T21:31:40.378517914Z }
17782024-09-10T21:31:40.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6bef7de0-10a2-40f3-a3e0-24be34732806 roles = RoleSet { roles: {} } uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17792024-09-10T21:31:40.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6bef7de0-10a2-40f3-a3e0-24be34732806 resource = Database result = Ok(()) uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17802024-09-10T21:31:40.439ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update
17812024-09-10T21:31:40.440ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"53ccff73-54b9-4394-92ab-a634606c67a5","lookup_type":{"ById":"53ccff73-54b9-4394-92ab-a634606c67a5"},"parent":{"key":"448f551c-01bd-448a-b11d-bb2152f07888","lookup_type":{"ById":"448f551c-01bd-448a-b11d-bb2152f07888"},"parent":{"key":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","lookup_type":{"ById":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
17822024-09-10T21:31:40.440ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update
17832024-09-10T21:31:40.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 36750 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6bef7de0-10a2-40f3-a3e0-24be34732806 response_code = 204 uri = /vmms/12a57104-3b71-45c4-bbff-e90aa18443a8
17842024-09-10T21:31:40.478ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update
17852024-09-10T21:31:40.478ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
17862024-09-10T21:31:40.478ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
17872024-09-10T21:31:40.478ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
17882024-09-10T21:31:40.484ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
17892024-09-10T21:31:40.484ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
17902024-09-10T21:31:40.490ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
17912024-09-10T21:31:40.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
17922024-09-10T21:31:40.495ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
17932024-09-10T21:31:40.495ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("91e60ff0-a666-4057-8f70-66277a201ab8")) node_id = 0 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
17942024-09-10T21:31:40.501ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
17952024-09-10T21:31:40.501ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
17962024-09-10T21:31:40.505ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update
17972024-09-10T21:31:40.505ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
17982024-09-10T21:31:40.506ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
17992024-09-10T21:31:40.510ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18002024-09-10T21:31:40.510ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18012024-09-10T21:31:40.512ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18022024-09-10T21:31:40.512ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18032024-09-10T21:31:40.514ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18042024-09-10T21:31:40.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18052024-09-10T21:31:40.515ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18062024-09-10T21:31:40.516ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18072024-09-10T21:31:40.517ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18082024-09-10T21:31:40.517ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18092024-09-10T21:31:40.518ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18102024-09-10T21:31:40.521ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, lookup_type: ById(644a396e-dfc8-46ce-bf81-7b188fb4c5ae) }, key: 448f551c-01bd-448a-b11d-bb2152f07888, lookup_type: ById(448f551c-01bd-448a-b11d-bb2152f07888) }, key: 53ccff73-54b9-4394-92ab-a634606c67a5, lookup_type: ById(53ccff73-54b9-4394-92ab-a634606c67a5) } result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18112024-09-10T21:31:40.521ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance updater_id = 91e60ff0-a666-4057-8f70-66277a201ab8
18122024-09-10T21:31:40.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18132024-09-10T21:31:40.521ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18142024-09-10T21:31:40.553ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance updater_id = 91e60ff0-a666-4057-8f70-66277a201ab8
18152024-09-10T21:31:40.553ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18162024-09-10T21:31:40.553ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance
18172024-09-10T21:31:40.558ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 locked_gen = Generation(Generation(2)) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = LockInstance updater_id = 91e60ff0-a666-4057-8f70-66277a201ab8
18182024-09-10T21:31:40.558ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18192024-09-10T21:31:40.558ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("91e60ff0-a666-4057-8f70-66277a201ab8")}) node_id = 1 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
18202024-09-10T21:31:40.563ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18212024-09-10T21:31:40.563ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
18222024-09-10T21:31:40.580ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18232024-09-10T21:31:40.580ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18242024-09-10T21:31:40.582ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18252024-09-10T21:31:40.582ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18262024-09-10T21:31:40.584ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18272024-09-10T21:31:40.584ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18282024-09-10T21:31:40.585ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18292024-09-10T21:31:40.588ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, lookup_type: ById(644a396e-dfc8-46ce-bf81-7b188fb4c5ae) }, key: 448f551c-01bd-448a-b11d-bb2152f07888, lookup_type: ById(448f551c-01bd-448a-b11d-bb2152f07888) }, key: 53ccff73-54b9-4394-92ab-a634606c67a5, lookup_type: ById(53ccff73-54b9-4394-92ab-a634606c67a5) } result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18302024-09-10T21:31:40.588ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18312024-09-10T21:31:40.588ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
18322024-09-10T21:31:40.598ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 12a57104-3b71-45c4-bbff-e90aa18443a8, time_created: 2024-09-10T21:31:16.705906Z, time_deleted: None, instance_id: 53ccff73-54b9-4394-92ab-a634606c67a5, sled_id: 403254df-bc94-46d0-9b33-45b17d93603a, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-10T21:31:40.378517Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-10T21:31:16.775086Z, gen: Generation(Generation(3)), propolis_id: Some(12a57104-3b71-45c4-bbff-e90aa18443a8), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(12a57104-3b71-45c4-bbff-e90aa18443a8 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-10T21:31:40.595983828Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
18332024-09-10T21:31:40.600ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18342024-09-10T21:31:40.600ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"53ccff73-54b9-4394-92ab-a634606c67a5","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"12a57104-3b71-45c4-bbff-e90aa18443a8"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"53ccff73-54b9-4394-92ab-a634606c67a5","lookup_type":{"ById":"53ccff73-54b9-4394-92ab-a634606c67a5"},"parent":{"key":"448f551c-01bd-448a-b11d-bb2152f07888","lookup_type":{"ById":"448f551c-01bd-448a-b11d-bb2152f07888"},"parent":{"key":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","lookup_type":{"ById":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"91e60ff0-a666-4057-8f70-66277a201ab8"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"448f551c-01bd-448a-b11d-bb2152f07888","ram_diff":1073741824},"destroy_active_vmm":"12a57104-3b71-45c4-bbff-e90aa18443a8","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-09-10T21:31:40.595983828Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18352024-09-10T21:31:40.600ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18362024-09-10T21:31:40.605ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18372024-09-10T21:31:40.605ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18382024-09-10T21:31:40.605ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18392024-09-10T21:31:40.605ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18402024-09-10T21:31:40.611ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18412024-09-10T21:31:40.611ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18422024-09-10T21:31:40.615ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18432024-09-10T21:31:40.615ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18442024-09-10T21:31:40.621ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18452024-09-10T21:31:40.621ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb")) node_id = 0 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18462024-09-10T21:31:40.626ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18472024-09-10T21:31:40.626ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18482024-09-10T21:31:40.631ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 parent_lock = UpdaterLock { updater_id: 91e60ff0-a666-4057-8f70-66277a201ab8, locked_gen: Generation(Generation(2)) } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18492024-09-10T21:31:40.632ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = BecomeUpdater
18502024-09-10T21:31:40.632ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = BecomeUpdater
18512024-09-10T21:31:40.642ZDEBGnexus (SagaExecutor): inherited lock from 91e60ff0-a666-4057-8f70-66277a201ab8 to a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 91e60ff0-a666-4057-8f70-66277a201ab8 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = BecomeUpdater updater_id = a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb
18522024-09-10T21:31:40.642ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:944 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18532024-09-10T21:31:40.642ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18542024-09-10T21:31:40.642ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb")}) node_id = 1 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18552024-09-10T21:31:40.646ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18562024-09-10T21:31:40.646ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18572024-09-10T21:31:40.651ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18582024-09-10T21:31:40.651ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18592024-09-10T21:31:40.656ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18602024-09-10T21:31:40.656ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18612024-09-10T21:31:40.660ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:997 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18622024-09-10T21:31:40.662ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5
18632024-09-10T21:31:40.662ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UpdateNetworkConfig
18642024-09-10T21:31:40.663ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UpdateNetworkConfig
18652024-09-10T21:31:40.665ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UpdateNetworkConfig
18662024-09-10T21:31:40.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UpdateNetworkConfig
18672024-09-10T21:31:40.667ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
18682024-09-10T21:31:40.667ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UpdateNetworkConfig
18692024-09-10T21:31:40.667ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UpdateNetworkConfig
18702024-09-10T21:31:40.669ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
18712024-09-10T21:31:40.669ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
18722024-09-10T21:31:40.670ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
18732024-09-10T21:31:40.671ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
18742024-09-10T21:31:40.672ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
18752024-09-10T21:31:40.672ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
18762024-09-10T21:31:40.672ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
18772024-09-10T21:31:40.676ZDEBGnexus: notifying dendrite of updates instance_id = Some(53ccff73-54b9-4394-92ab-a634606c67a5 (instance)) switch = switch0
18782024-09-10T21:31:40.677ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2852, tv_nsec: 194892278 } })
18792024-09-10T21:31:40.677ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
18802024-09-10T21:31:40.708ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
18812024-09-10T21:31:40.708ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18822024-09-10T21:31:40.708ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cece9da2-f578-424f-8290-ff2cee732ac6", "content-length": "26", "date": "Tue, 10 Sep 2024 21:31:40 GMT"} })
18832024-09-10T21:31:40.708ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18842024-09-10T21:31:40.709ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18852024-09-10T21:31:40.739ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
18862024-09-10T21:31:40.739ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "04456bf5-02da-4965-ba85-4829101dfd9d", "content-length": "4", "date": "Tue, 10 Sep 2024 21:31:40 GMT"} })
18872024-09-10T21:31:40.740ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18882024-09-10T21:31:40.740ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18892024-09-10T21:31:40.745ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18902024-09-10T21:31:40.745ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18912024-09-10T21:31:40.750ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = ReleaseVirtualProvisioning
18922024-09-10T21:31:40.750ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = ReleaseVirtualProvisioning
18932024-09-10T21:31:40.761ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1072 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-10T21:31:40.753219Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 448f551c-01bd-448a-b11d-bb2152f07888, time_modified: Some(2024-09-10T21:31:40.753219Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, time_modified: Some(2024-09-10T21:31:40.753219Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18942024-09-10T21:31:40.761ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18952024-09-10T21:31:40.761ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18962024-09-10T21:31:40.764ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
18972024-09-10T21:31:40.764ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
18982024-09-10T21:31:40.768ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1107 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
18992024-09-10T21:31:40.768ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UnassignOximeterProducer
19002024-09-10T21:31:40.768ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UnassignOximeterProducer
19012024-09-10T21:31:40.772ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed producer_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19022024-09-10T21:31:40.772ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UnassignOximeterProducer
19032024-09-10T21:31:40.772ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = UnassignOximeterProducer
19042024-09-10T21:31:40.805ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19052024-09-10T21:31:40.805ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/53ccff73-54b9-4394-92ab-a634606c67a5
19062024-09-10T21:31:40.805ZDEBGnexus (SagaExecutor): client response oximeter-collector = 53ccff73-54b9-4394-92ab-a634606c67a5 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/53ccff73-54b9-4394-92ab-a634606c67a5", query: None, fragment: None }, status: 204, headers: {"x-request-id": "080e8671-0f23-4ab7-9f4c-63b9c829bb20", "date": "Tue, 10 Sep 2024 21:31:40 GMT"} }) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19072024-09-10T21:31:40.805ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed producer_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19082024-09-10T21:31:40.806ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19092024-09-10T21:31:40.806ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19102024-09-10T21:31:40.809ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19112024-09-10T21:31:40.810ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19122024-09-10T21:31:40.813ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 lock = UpdaterLock { updater_id: a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-10T21:31:40.595983828Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19132024-09-10T21:31:40.813ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19142024-09-10T21:31:40.813ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19152024-09-10T21:31:40.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 819fa9a6-0158-4c65-99fd-9371c904f4af roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
19162024-09-10T21:31:40.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 819fa9a6-0158-4c65-99fd-9371c904f4af resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
19172024-09-10T21:31:40.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 819fa9a6-0158-4c65-99fd-9371c904f4af response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
19182024-09-10T21:31:40.847ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1156 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 new_runtime = InstanceRuntimeState { time_updated: 2024-09-10T21:31:40.595983828Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19192024-09-10T21:31:40.847ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19202024-09-10T21:31:40.847ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Signaled
19212024-09-10T21:31:40.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19222024-09-10T21:31:40.847ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19232024-09-10T21:31:40.847ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Signaled
19242024-09-10T21:31:40.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19252024-09-10T21:31:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19262024-09-10T21:31:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19272024-09-10T21:31:40.848ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19282024-09-10T21:31:40.849ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19292024-09-10T21:31:40.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19302024-09-10T21:31:40.850ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19312024-09-10T21:31:40.850ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19322024-09-10T21:31:40.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19332024-09-10T21:31:40.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19342024-09-10T21:31:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19352024-09-10T21:31:40.851ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19362024-09-10T21:31:40.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372024-09-10T21:31:40.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19382024-09-10T21:31:40.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19392024-09-10T21:31:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19402024-09-10T21:31:40.855ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, lookup_type: ById(644a396e-dfc8-46ce-bf81-7b188fb4c5ae) }, key: 448f551c-01bd-448a-b11d-bb2152f07888, lookup_type: ById(448f551c-01bd-448a-b11d-bb2152f07888) }, key: 53ccff73-54b9-4394-92ab-a634606c67a5, lookup_type: ById(53ccff73-54b9-4394-92ab-a634606c67a5) } result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19412024-09-10T21:31:40.855ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19422024-09-10T21:31:40.855ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = CommitInstanceUpdates
19432024-09-10T21:31:40.858ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19442024-09-10T21:31:40.858ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19452024-09-10T21:31:40.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19462024-09-10T21:31:40.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19472024-09-10T21:31:40.862ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19482024-09-10T21:31:40.862ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19492024-09-10T21:31:40.865ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19502024-09-10T21:31:40.865ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("53ccff73-54b9-4394-92ab-a634606c67a5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("12a57104-3b71-45c4-bbff-e90aa18443a8")}) node_id = 7 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19512024-09-10T21:31:40.869ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19522024-09-10T21:31:40.869ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19532024-09-10T21:31:40.873ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19542024-09-10T21:31:40.873ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19552024-09-10T21:31:40.876ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19562024-09-10T21:31:40.876ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19572024-09-10T21:31:40.881ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19582024-09-10T21:31:40.881ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = ReleaseSledResources
19592024-09-10T21:31:40.881ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = ReleaseSledResources
19602024-09-10T21:31:40.887ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19612024-09-10T21:31:40.888ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19622024-09-10T21:31:40.893ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19632024-09-10T21:31:40.893ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19642024-09-10T21:31:40.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19652024-09-10T21:31:40.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19662024-09-10T21:31:40.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672024-09-10T21:31:40.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19682024-09-10T21:31:40.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19692024-09-10T21:31:40.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19702024-09-10T21:31:40.898ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 propolis_id = 12a57104-3b71-45c4-bbff-e90aa18443a8 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update
19712024-09-10T21:31:40.898ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = MarkVmmDeleted
19722024-09-10T21:31:40.898ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_node = MarkVmmDeleted
19732024-09-10T21:31:40.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19742024-09-10T21:31:40.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19752024-09-10T21:31:40.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19762024-09-10T21:31:40.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19772024-09-10T21:31:40.908ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19782024-09-10T21:31:40.908ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19792024-09-10T21:31:40.911ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19802024-09-10T21:31:40.911ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19812024-09-10T21:31:40.915ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19822024-09-10T21:31:40.915ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19832024-09-10T21:31:40.918ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19842024-09-10T21:31:40.918ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19852024-09-10T21:31:40.921ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19862024-09-10T21:31:40.921ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19872024-09-10T21:31:40.966ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19882024-09-10T21:31:40.966ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3794c16b-079f-4251-8177-e47da96d8db8", "content-length": "691", "date": "Tue, 10 Sep 2024 21:31:40 GMT"} })
19892024-09-10T21:31:40.966ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
19902024-09-10T21:31:40.966ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
19912024-09-10T21:31:40.966ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
19922024-09-10T21:31:40.967ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19932024-09-10T21:31:40.968ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "41635ce4-fd0c-44d7-985a-c23ddb3c551b", "content-length": "372", "date": "Tue, 10 Sep 2024 21:31:40 GMT"} })
19942024-09-10T21:31:40.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19952024-09-10T21:31:40.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19962024-09-10T21:31:40.968ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 121.56865ms iteration = 16 status = {}
19972024-09-10T21:31:40.969ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
19982024-09-10T21:31:40.969ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb
19992024-09-10T21:31:40.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20002024-09-10T21:31:40.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20012024-09-10T21:31:40.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20022024-09-10T21:31:40.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20032024-09-10T21:31:40.975ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20042024-09-10T21:31:40.975ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a662a335-d645-42d3-b84f-7f2a941bd401", "date": "Tue, 10 Sep 2024 21:31:40 GMT"} })
20052024-09-10T21:31:40.977ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
20062024-09-10T21:31:40.977ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 129.875825ms iteration = 17 status = {}
20072024-09-10T21:31:40.977ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb saga_name = instance-update saga_result = SagaResult { saga_id: e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb, saga_log: SagaLog { saga_id: e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("53ccff73-54b9-4394-92ab-a634606c67a5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("12a57104-3b71-45c4-bbff-e90aa18443a8")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("53ccff73-54b9-4394-92ab-a634606c67a5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("12a57104-3b71-45c4-bbff-e90aa18443a8")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a4a1da5e-c1fb-46d5-97d8-1105c4fa3ebb")}} }) }
20082024-09-10T21:31:40.977ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = e3bf4db5-adb8-474b-a8d3-2a3fbd095fcb instance_id = 53ccff73-54b9-4394-92ab-a634606c67a5 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update
20092024-09-10T21:31:40.977ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
20102024-09-10T21:31:40.977ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
20112024-09-10T21:31:40.980ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
20122024-09-10T21:31:40.980ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
20132024-09-10T21:31:40.983ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
20142024-09-10T21:31:40.983ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
20152024-09-10T21:31:40.987ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
20162024-09-10T21:31:40.987ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db
20172024-09-10T21:31:41.037ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update sec_id = 19a73de5-6a55-413b-9592-dba813ea235c
20182024-09-10T21:31:41.038ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 1b49f6e9-3bba-4b01-b836-cc96ce5756db saga_name = start-instance-update saga_result = SagaResult { saga_id: 1b49f6e9-3bba-4b01-b836-cc96ce5756db, saga_log: SagaLog { saga_id: 1b49f6e9-3bba-4b01-b836-cc96ce5756db, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("91e60ff0-a666-4057-8f70-66277a201ab8")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("91e60ff0-a666-4057-8f70-66277a201ab8")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("91e60ff0-a666-4057-8f70-66277a201ab8"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("91e60ff0-a666-4057-8f70-66277a201ab8")}} }) }
20192024-09-10T21:31:41.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fade2eed-1dfe-4da3-8bca-507627545837 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20202024-09-10T21:31:41.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fade2eed-1dfe-4da3-8bca-507627545837 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20212024-09-10T21:31:41.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fade2eed-1dfe-4da3-8bca-507627545837 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20222024-09-10T21:31:41.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 40e5f450-614b-402f-a51b-171a18070ea2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20232024-09-10T21:31:41.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 40e5f450-614b-402f-a51b-171a18070ea2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20242024-09-10T21:31:41.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 40e5f450-614b-402f-a51b-171a18070ea2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20252024-09-10T21:31:42.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f8b4567-b79d-4c0b-a45f-17e10d927e27 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20262024-09-10T21:31:42.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f8b4567-b79d-4c0b-a45f-17e10d927e27 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20272024-09-10T21:31:42.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8f8b4567-b79d-4c0b-a45f-17e10d927e27 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20282024-09-10T21:31:43.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8dafa22b-bb2c-4c61-b7b0-6f477adee211 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20292024-09-10T21:31:43.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8dafa22b-bb2c-4c61-b7b0-6f477adee211 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20302024-09-10T21:31:43.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8dafa22b-bb2c-4c61-b7b0-6f477adee211 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20312024-09-10T21:31:44.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e139a721-820d-485a-a7f6-1d5a7aeb1fb5 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20322024-09-10T21:31:44.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e139a721-820d-485a-a7f6-1d5a7aeb1fb5 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20332024-09-10T21:31:44.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e139a721-820d-485a-a7f6-1d5a7aeb1fb5 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20342024-09-10T21:31:45.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 285ee3e4-dcdf-4993-91c9-f5781c9b5fa2 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20352024-09-10T21:31:45.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 285ee3e4-dcdf-4993-91c9-f5781c9b5fa2 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20362024-09-10T21:31:45.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 285ee3e4-dcdf-4993-91c9-f5781c9b5fa2 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20372024-09-10T21:31:45.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
20382024-09-10T21:31:45.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20392024-09-10T21:31:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20402024-09-10T21:31:45.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
20412024-09-10T21:31:45.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20422024-09-10T21:31:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20432024-09-10T21:31:45.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20442024-09-10T21:31:45.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20452024-09-10T21:31:45.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20462024-09-10T21:31:45.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20472024-09-10T21:31:45.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20482024-09-10T21:31:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20492024-09-10T21:31:45.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.855564ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20502024-09-10T21:31:45.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20512024-09-10T21:31:45.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20522024-09-10T21:31:45.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20532024-09-10T21:31:45.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
20542024-09-10T21:31:45.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20552024-09-10T21:31:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20562024-09-10T21:31:45.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
20572024-09-10T21:31:45.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.490503ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
20582024-09-10T21:31:46.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2c06d4a5-c89c-4aa8-a5eb-2bbe678486c4 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20592024-09-10T21:31:46.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2c06d4a5-c89c-4aa8-a5eb-2bbe678486c4 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20602024-09-10T21:31:46.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2c06d4a5-c89c-4aa8-a5eb-2bbe678486c4 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20612024-09-10T21:31:47.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c7194906-435b-4677-be0a-c2751bf1cdc6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20622024-09-10T21:31:47.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c7194906-435b-4677-be0a-c2751bf1cdc6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20632024-09-10T21:31:47.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c7194906-435b-4677-be0a-c2751bf1cdc6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20642024-09-10T21:31:48.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b5cb57ff-c8ec-4a2f-a401-2534be38529b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20652024-09-10T21:31:48.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b5cb57ff-c8ec-4a2f-a401-2534be38529b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20662024-09-10T21:31:48.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b5cb57ff-c8ec-4a2f-a401-2534be38529b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20672024-09-10T21:31:48.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = d1054022-d008-458f-9f48-f42ef1e654fd response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
20682024-09-10T21:31:49.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 666f1407-9649-49fd-950a-dc3e1c23091e roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20692024-09-10T21:31:49.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 666f1407-9649-49fd-950a-dc3e1c23091e resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20702024-09-10T21:31:49.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 666f1407-9649-49fd-950a-dc3e1c23091e response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20712024-09-10T21:31:50.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3a7daeb2-7329-4441-92b7-3675ed2e9e74 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20722024-09-10T21:31:50.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3a7daeb2-7329-4441-92b7-3675ed2e9e74 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20732024-09-10T21:31:50.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3a7daeb2-7329-4441-92b7-3675ed2e9e74 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20742024-09-10T21:31:51.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a9c6b38f-59f2-48f4-99c5-840cfbcca893 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20752024-09-10T21:31:51.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a9c6b38f-59f2-48f4-99c5-840cfbcca893 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20762024-09-10T21:31:51.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a9c6b38f-59f2-48f4-99c5-840cfbcca893 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20772024-09-10T21:31:52.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 958f89ea-9b9c-4972-bb31-dd4aa1f1093c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20782024-09-10T21:31:52.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 958f89ea-9b9c-4972-bb31-dd4aa1f1093c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20792024-09-10T21:31:52.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 958f89ea-9b9c-4972-bb31-dd4aa1f1093c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20802024-09-10T21:31:53.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9c74ce1f-db52-4efb-bdbf-a63e736a17dc roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20812024-09-10T21:31:53.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9c74ce1f-db52-4efb-bdbf-a63e736a17dc resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20822024-09-10T21:31:53.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9c74ce1f-db52-4efb-bdbf-a63e736a17dc response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20832024-09-10T21:31:54.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7110216b-3457-44d8-aea1-639340c1ceed roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20842024-09-10T21:31:54.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7110216b-3457-44d8-aea1-639340c1ceed resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20852024-09-10T21:31:54.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7110216b-3457-44d8-aea1-639340c1ceed response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20862024-09-10T21:31:55.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1db741bf-4408-46c3-a3a3-cd245b932e55 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20872024-09-10T21:31:55.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1db741bf-4408-46c3-a3a3-cd245b932e55 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20882024-09-10T21:31:55.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1db741bf-4408-46c3-a3a3-cd245b932e55 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
20892024-09-10T21:31:55.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
20902024-09-10T21:31:55.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20912024-09-10T21:31:55.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20922024-09-10T21:31:55.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
20932024-09-10T21:31:55.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20942024-09-10T21:31:55.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20952024-09-10T21:31:55.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20962024-09-10T21:31:55.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20972024-09-10T21:31:55.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20982024-09-10T21:31:55.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20992024-09-10T21:31:55.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21002024-09-10T21:31:55.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21012024-09-10T21:31:55.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21022024-09-10T21:31:55.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21032024-09-10T21:31:55.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21042024-09-10T21:31:55.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
21052024-09-10T21:31:55.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21062024-09-10T21:31:55.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21072024-09-10T21:31:55.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
21082024-09-10T21:31:55.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.245108ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
21092024-09-10T21:31:55.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.18858ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21102024-09-10T21:31:56.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5c6fa326-7528-4ba6-ab62-7237d07ac330 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21112024-09-10T21:31:56.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5c6fa326-7528-4ba6-ab62-7237d07ac330 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21122024-09-10T21:31:56.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5c6fa326-7528-4ba6-ab62-7237d07ac330 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21132024-09-10T21:31:57.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c81a4519-56a8-4d60-a665-00e1742f9365 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21142024-09-10T21:31:57.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c81a4519-56a8-4d60-a665-00e1742f9365 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21152024-09-10T21:31:57.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c81a4519-56a8-4d60-a665-00e1742f9365 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21162024-09-10T21:31:58.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eea42f25-f531-4f9f-9d01-e1a32f8fa71a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21172024-09-10T21:31:58.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eea42f25-f531-4f9f-9d01-e1a32f8fa71a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21182024-09-10T21:31:58.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eea42f25-f531-4f9f-9d01-e1a32f8fa71a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21192024-09-10T21:31:58.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 96ffc6bb-e6c8-4a13-bd55-78acf4594936 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
21202024-09-10T21:31:59.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fa0805ec-bd7d-43a5-b228-3a814714db30 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21212024-09-10T21:31:59.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fa0805ec-bd7d-43a5-b228-3a814714db30 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21222024-09-10T21:31:59.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fa0805ec-bd7d-43a5-b228-3a814714db30 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21232024-09-10T21:32:00.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1d815f44-2858-4e79-8764-b09fc706ec79 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21242024-09-10T21:32:00.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1d815f44-2858-4e79-8764-b09fc706ec79 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21252024-09-10T21:32:00.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1d815f44-2858-4e79-8764-b09fc706ec79 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21262024-09-10T21:32:01.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5e2c6c5f-5eda-4f3d-9688-e3b719074f31 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21272024-09-10T21:32:01.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5e2c6c5f-5eda-4f3d-9688-e3b719074f31 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21282024-09-10T21:32:01.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5e2c6c5f-5eda-4f3d-9688-e3b719074f31 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21292024-09-10T21:32:02.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 635dd3f2-823f-47cc-8b9e-8cad39d27ef0 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21302024-09-10T21:32:02.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 635dd3f2-823f-47cc-8b9e-8cad39d27ef0 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21312024-09-10T21:32:02.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 635dd3f2-823f-47cc-8b9e-8cad39d27ef0 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21322024-09-10T21:32:03.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 374b7219-c275-496d-a256-ff42eb284dec roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21332024-09-10T21:32:03.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 374b7219-c275-496d-a256-ff42eb284dec resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21342024-09-10T21:32:03.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 374b7219-c275-496d-a256-ff42eb284dec response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21352024-09-10T21:32:04.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c4f581b2-8ca2-4597-a8e3-63f9c53f41cf roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21362024-09-10T21:32:04.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c4f581b2-8ca2-4597-a8e3-63f9c53f41cf resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21372024-09-10T21:32:04.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c4f581b2-8ca2-4597-a8e3-63f9c53f41cf response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
21382024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
21392024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21402024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
21412024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
21422024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21432024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21442024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
21452024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21462024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
21472024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
21482024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21492024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
21502024-09-10T21:32:05.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21512024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
21522024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21532024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
21542024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21552024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21562024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21572024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21582024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21592024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21602024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21612024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21622024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21632024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
21642024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
21652024-09-10T21:32:05.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21662024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21672024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
21682024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21692024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21702024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
21712024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21722024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
21732024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
21742024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
21752024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21762024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
21772024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21782024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
21792024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21802024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21812024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21822024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21832024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21842024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21852024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21862024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21872024-09-10T21:32:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21882024-09-10T21:32:05.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21892024-09-10T21:32:05.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21902024-09-10T21:32:05.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21912024-09-10T21:32:05.767ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2877, tv_nsec: 285013281 } })
21922024-09-10T21:32:05.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
21932024-09-10T21:32:05.768ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.57085ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21942024-09-10T21:32:05.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21952024-09-10T21:32:05.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21962024-09-10T21:32:05.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21972024-09-10T21:32:05.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21982024-09-10T21:32:05.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21992024-09-10T21:32:05.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22002024-09-10T21:32:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22012024-09-10T21:32:05.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22022024-09-10T21:32:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22032024-09-10T21:32:05.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2877, tv_nsec: 290111890 } })
22042024-09-10T21:32:05.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
22052024-09-10T21:32:05.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22062024-09-10T21:32:05.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22072024-09-10T21:32:05.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22082024-09-10T21:32:05.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22092024-09-10T21:32:05.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22102024-09-10T21:32:05.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22112024-09-10T21:32:05.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22122024-09-10T21:32:05.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22132024-09-10T21:32:05.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22142024-09-10T21:32:05.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22152024-09-10T21:32:05.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2877, tv_nsec: 297212294 } })
22162024-09-10T21:32:05.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22172024-09-10T21:32:05.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22182024-09-10T21:32:05.780ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22192024-09-10T21:32:05.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
22202024-09-10T21:32:05.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22212024-09-10T21:32:05.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22222024-09-10T21:32:05.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22232024-09-10T21:32:05.785ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
22242024-09-10T21:32:05.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.604259ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
22252024-09-10T21:32:05.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22262024-09-10T21:32:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22272024-09-10T21:32:05.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22282024-09-10T21:32:05.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22292024-09-10T21:32:05.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22302024-09-10T21:32:05.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22312024-09-10T21:32:05.806ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
22322024-09-10T21:32:05.806ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22332024-09-10T21:32:05.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22342024-09-10T21:32:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22352024-09-10T21:32:05.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22362024-09-10T21:32:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22372024-09-10T21:32:05.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.058404ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
22382024-09-10T21:32:05.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22392024-09-10T21:32:05.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22402024-09-10T21:32:05.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22412024-09-10T21:32:05.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22422024-09-10T21:32:05.809ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
22432024-09-10T21:32:05.809ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22442024-09-10T21:32:05.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22452024-09-10T21:32:05.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22462024-09-10T21:32:05.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.484696ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
22472024-09-10T21:32:05.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22482024-09-10T21:32:05.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22492024-09-10T21:32:05.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22502024-09-10T21:32:05.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22512024-09-10T21:32:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22522024-09-10T21:32:05.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22532024-09-10T21:32:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22542024-09-10T21:32:05.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22552024-09-10T21:32:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
22562024-09-10T21:32:05.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22572024-09-10T21:32:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22582024-09-10T21:32:05.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22592024-09-10T21:32:05.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22602024-09-10T21:32:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22612024-09-10T21:32:05.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22622024-09-10T21:32:05.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22632024-09-10T21:32:05.816ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.299623ms iteration = 16 status = 0
22642024-09-10T21:32:05.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.322097ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22652024-09-10T21:32:05.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22662024-09-10T21:32:05.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22672024-09-10T21:32:05.844ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
22682024-09-10T21:32:05.844ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22692024-09-10T21:32:05.844ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
22702024-09-10T21:32:05.844ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22712024-09-10T21:32:05.844ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.140481ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
22722024-09-10T21:32:05.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.195312ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22732024-09-10T21:32:05.844ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f3ae97f7-012d-4eb6-b107-ed56407f532b", "content-length": "26", "date": "Tue, 10 Sep 2024 21:32:05 GMT"} })
22742024-09-10T21:32:05.844ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22752024-09-10T21:32:05.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22762024-09-10T21:32:05.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.147278ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
22772024-09-10T21:32:05.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22782024-09-10T21:32:05.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
22792024-09-10T21:32:05.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22802024-09-10T21:32:05.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22812024-09-10T21:32:05.858ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
22822024-09-10T21:32:05.858ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22832024-09-10T21:32:05.858ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f65fc414-eaa5-450f-b45d-be607f306fe8", "content-length": "26", "date": "Tue, 10 Sep 2024 21:32:05 GMT"} })
22842024-09-10T21:32:05.858ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22852024-09-10T21:32:05.859ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22862024-09-10T21:32:05.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
22872024-09-10T21:32:05.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.085246ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
22882024-09-10T21:32:05.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
22892024-09-10T21:32:05.865ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22902024-09-10T21:32:05.866ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7b2b425-3577-43cf-9ced-f0d5dbe27c64", "content-length": "26", "date": "Tue, 10 Sep 2024 21:32:05 GMT"} })
22912024-09-10T21:32:05.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22922024-09-10T21:32:05.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
22932024-09-10T21:32:05.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.493651ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22942024-09-10T21:32:05.877ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.591011ms iteration = 19 status = {"physical_disks_added":0}
22952024-09-10T21:32:05.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = df666521-ac63-4ff8-be53-9a2b812a2835 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
22962024-09-10T21:32:05.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22972024-09-10T21:32:05.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = df666521-ac63-4ff8-be53-9a2b812a2835 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
22982024-09-10T21:32:05.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22992024-09-10T21:32:05.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = df666521-ac63-4ff8-be53-9a2b812a2835 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
23002024-09-10T21:32:05.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23012024-09-10T21:32:05.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23022024-09-10T21:32:05.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23032024-09-10T21:32:05.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23042024-09-10T21:32:05.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052024-09-10T21:32:05.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23062024-09-10T21:32:05.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23072024-09-10T21:32:05.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23082024-09-10T21:32:06.008ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 244.73522ms iteration = 16 status = {}
23092024-09-10T21:32:06.036ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23102024-09-10T21:32:06.037ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b5ca234-c670-43b8-b7ea-0f227de16cb7", "content-length": "372", "date": "Tue, 10 Sep 2024 21:32:06 GMT"} })
23112024-09-10T21:32:06.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23122024-09-10T21:32:06.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23132024-09-10T21:32:06.051ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23142024-09-10T21:32:06.051ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "98d3ef26-c4da-4ef4-aa78-2fbff72651b2", "content-length": "2", "date": "Tue, 10 Sep 2024 21:32:05 GMT"} })
23152024-09-10T21:32:06.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23162024-09-10T21:32:06.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23172024-09-10T21:32:06.062ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23182024-09-10T21:32:06.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f54e407-ab88-4776-acf1-62f4be436f0c", "content-length": "691", "date": "Tue, 10 Sep 2024 21:32:06 GMT"} })
23192024-09-10T21:32:06.063ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23202024-09-10T21:32:06.063ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23212024-09-10T21:32:06.063ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23222024-09-10T21:32:06.064ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.658565ms iteration = 17 status = {}
23232024-09-10T21:32:06.065ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 301.237406ms iteration = 16 status = null
23242024-09-10T21:32:06.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23252024-09-10T21:32:06.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23262024-09-10T21:32:06.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23272024-09-10T21:32:06.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23282024-09-10T21:32:06.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23292024-09-10T21:32:06.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "77e0bf32-efb3-4d1f-8f4b-822f437cba2f", "date": "Tue, 10 Sep 2024 21:32:06 GMT"} })
23302024-09-10T21:32:06.073ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.700776ms iteration = 18 status = {}
23312024-09-10T21:32:06.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23322024-09-10T21:32:06.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23332024-09-10T21:32:06.145ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
23342024-09-10T21:32:06.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23352024-09-10T21:32:06.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23362024-09-10T21:32:06.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23372024-09-10T21:32:06.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fbb420da-d3c3-421e-89b4-9caef494d85c", "content-length": "121", "date": "Tue, 10 Sep 2024 21:32:05 GMT"} })
23382024-09-10T21:32:06.156ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
23392024-09-10T21:32:06.156ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
23402024-09-10T21:32:06.156ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23412024-09-10T21:32:06.156ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23422024-09-10T21:32:06.156ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
23432024-09-10T21:32:06.156ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
23442024-09-10T21:32:06.156ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
23452024-09-10T21:32:06.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23462024-09-10T21:32:06.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23472024-09-10T21:32:06.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23482024-09-10T21:32:06.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "432085f0-ca03-4b9f-8dbf-ccd442cccb0e", "content-length": "2", "date": "Tue, 10 Sep 2024 21:32:05 GMT"} })
23492024-09-10T21:32:06.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23502024-09-10T21:32:06.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60289a62-17c2-487d-b459-949cdcfc4bf4", "content-length": "52", "date": "Tue, 10 Sep 2024 21:32:05 GMT"} })
23512024-09-10T21:32:06.159ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
23522024-09-10T21:32:06.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23532024-09-10T21:32:06.255ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9a7d973f-7e05-4771-9131-44b7053b780a", "date": "Tue, 10 Sep 2024 21:32:06 GMT"} })
23542024-09-10T21:32:06.255ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
23552024-09-10T21:32:06.255ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23562024-09-10T21:32:06.255ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e91fdd6-795b-4450-b130-2351fd1e319e", "content-length": "667", "date": "Tue, 10 Sep 2024 21:32:06 GMT"} })
23572024-09-10T21:32:06.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23582024-09-10T21:32:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23592024-09-10T21:32:06.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23602024-09-10T21:32:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23612024-09-10T21:32:06.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23622024-09-10T21:32:06.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23632024-09-10T21:32:06.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23642024-09-10T21:32:06.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23652024-09-10T21:32:06.273ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 509.348297ms iteration = 16 status = {}
23662024-09-10T21:32:06.301ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40617
23672024-09-10T21:32:06.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40617 req_id = 8cf90b0f-0e0c-4f0f-bdaf-a1aecf98f5d8 roles = RoleSet { roles: {} } uri = /metrics/producers
23682024-09-10T21:32:06.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40617 req_id = 8cf90b0f-0e0c-4f0f-bdaf-a1aecf98f5d8 resource = Database result = Ok(()) uri = /metrics/producers
23692024-09-10T21:32:06.334ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
23702024-09-10T21:32:06.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40617 req_id = 8cf90b0f-0e0c-4f0f-bdaf-a1aecf98f5d8 roles = RoleSet { roles: {} } uri = /metrics/producers
23712024-09-10T21:32:06.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40617 req_id = 8cf90b0f-0e0c-4f0f-bdaf-a1aecf98f5d8 resource = Database result = Ok(()) uri = /metrics/producers
23722024-09-10T21:32:06.368ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
23732024-09-10T21:32:06.369ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3e076d78-1754-4e73-b827-801d22b58385", "date": "Tue, 10 Sep 2024 21:32:06 GMT"} })
23742024-09-10T21:32:06.369ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 3817645b-bf82-4294-ab73-827679215664
23752024-09-10T21:32:06.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68990 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40617 req_id = 8cf90b0f-0e0c-4f0f-bdaf-a1aecf98f5d8 response_code = 201 uri = /metrics/producers
23762024-09-10T21:32:06.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cfa9996a-18ef-4585-9ee6-2c7ea1069705 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
23772024-09-10T21:32:06.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cfa9996a-18ef-4585-9ee6-2c7ea1069705 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
23782024-09-10T21:32:06.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = cfa9996a-18ef-4585-9ee6-2c7ea1069705 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
23792024-09-10T21:32:07.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ceb133a2-06a6-4c1a-ac7f-c513247e3cf7 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
23802024-09-10T21:32:07.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ceb133a2-06a6-4c1a-ac7f-c513247e3cf7 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
23812024-09-10T21:32:07.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ceb133a2-06a6-4c1a-ac7f-c513247e3cf7 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
23822024-09-10T21:32:08.856ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1378 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 441c6b81-06e1-476e-93f9-8aefac416ca8 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
23832024-09-10T21:32:08.858ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23842024-09-10T21:32:08.858ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
23852024-09-10T21:32:08.888ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
23862024-09-10T21:32:08.889ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42974
23872024-09-10T21:32:08.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42974 req_id = 89d6a327-9a70-4d46-8e0a-f45354829e8b roles = RoleSet { roles: {} } uri = /metrics/producers
23882024-09-10T21:32:08.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42974 req_id = 89d6a327-9a70-4d46-8e0a-f45354829e8b resource = Database result = Ok(()) uri = /metrics/producers
23892024-09-10T21:32:08.924ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
23902024-09-10T21:32:08.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42974 req_id = 89d6a327-9a70-4d46-8e0a-f45354829e8b roles = RoleSet { roles: {} } uri = /metrics/producers
23912024-09-10T21:32:08.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42974 req_id = 89d6a327-9a70-4d46-8e0a-f45354829e8b resource = Database result = Ok(()) uri = /metrics/producers
23922024-09-10T21:32:08.963ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
23932024-09-10T21:32:08.963ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6f218036-f8b0-428f-a8cc-c67d6a9a1733", "date": "Tue, 10 Sep 2024 21:32:08 GMT"} })
23942024-09-10T21:32:08.963ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 19a73de5-6a55-413b-9592-dba813ea235c
23952024-09-10T21:32:08.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75473 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42974 req_id = 89d6a327-9a70-4d46-8e0a-f45354829e8b response_code = 201 uri = /metrics/producers
23962024-09-10T21:32:08.964ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "89d6a327-9a70-4d46-8e0a-f45354829e8b", "content-length": "41", "date": "Tue, 10 Sep 2024 21:32:08 GMT"} })
23972024-09-10T21:32:08.966ZDEBGnexus (producer-registration-task): registered with nexus successfully
23982024-09-10T21:32:08.966ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
23992024-09-10T21:32:08.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3d20d75e-5f23-4bcb-b498-b3c7c733ebfd roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24002024-09-10T21:32:08.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3d20d75e-5f23-4bcb-b498-b3c7c733ebfd resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24012024-09-10T21:32:08.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3d20d75e-5f23-4bcb-b498-b3c7c733ebfd response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24022024-09-10T21:32:09.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a5da69e5-8111-4078-aa1e-f76daa020560 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24032024-09-10T21:32:09.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a5da69e5-8111-4078-aa1e-f76daa020560 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24042024-09-10T21:32:09.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a5da69e5-8111-4078-aa1e-f76daa020560 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24052024-09-10T21:32:10.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 71d744ba-1eb6-420d-9029-27571ed695ae roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
24062024-09-10T21:32:10.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 71d744ba-1eb6-420d-9029-27571ed695ae resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
24072024-09-10T21:32:10.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 71d744ba-1eb6-420d-9029-27571ed695ae response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
24082024-09-10T21:32:11.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 23f7440f-1ade-4a3d-8279-630a554ba1a0 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24092024-09-10T21:32:11.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 23f7440f-1ade-4a3d-8279-630a554ba1a0 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24102024-09-10T21:32:11.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 23f7440f-1ade-4a3d-8279-630a554ba1a0 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24112024-09-10T21:32:12.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1b6ccc0a-244a-4304-ab0c-a96705ee8d3a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24122024-09-10T21:32:12.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1b6ccc0a-244a-4304-ab0c-a96705ee8d3a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24132024-09-10T21:32:12.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1b6ccc0a-244a-4304-ab0c-a96705ee8d3a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24142024-09-10T21:32:13.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6f650495-8c2b-4586-9bb9-48de5e79e62b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24152024-09-10T21:32:13.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6f650495-8c2b-4586-9bb9-48de5e79e62b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24162024-09-10T21:32:13.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6f650495-8c2b-4586-9bb9-48de5e79e62b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24172024-09-10T21:32:14.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 464fce57-b106-4a85-a708-a26292b7296c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24182024-09-10T21:32:14.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 464fce57-b106-4a85-a708-a26292b7296c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24192024-09-10T21:32:14.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 464fce57-b106-4a85-a708-a26292b7296c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24202024-09-10T21:32:15.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb643aca-9fb6-439e-9256-d6e6d11b3884 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24212024-09-10T21:32:15.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb643aca-9fb6-439e-9256-d6e6d11b3884 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24222024-09-10T21:32:15.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eb643aca-9fb6-439e-9256-d6e6d11b3884 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24232024-09-10T21:32:15.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
24242024-09-10T21:32:15.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24252024-09-10T21:32:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24262024-09-10T21:32:15.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
24272024-09-10T21:32:15.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24282024-09-10T21:32:15.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24292024-09-10T21:32:15.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24302024-09-10T21:32:15.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24312024-09-10T21:32:15.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24322024-09-10T21:32:15.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24332024-09-10T21:32:15.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24342024-09-10T21:32:15.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24352024-09-10T21:32:15.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24362024-09-10T21:32:15.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
24372024-09-10T21:32:15.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24382024-09-10T21:32:15.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24392024-09-10T21:32:15.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
24402024-09-10T21:32:15.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.949161ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
24412024-09-10T21:32:15.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24422024-09-10T21:32:15.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24432024-09-10T21:32:15.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.508131ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24442024-09-10T21:32:16.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1bcdbfbf-9b08-494e-9842-3ff1c4f3cf25 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24452024-09-10T21:32:16.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1bcdbfbf-9b08-494e-9842-3ff1c4f3cf25 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24462024-09-10T21:32:16.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1bcdbfbf-9b08-494e-9842-3ff1c4f3cf25 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24472024-09-10T21:32:17.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d2574d9f-aba9-4cac-8cf1-c55e0f152c3a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24482024-09-10T21:32:17.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d2574d9f-aba9-4cac-8cf1-c55e0f152c3a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24492024-09-10T21:32:17.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d2574d9f-aba9-4cac-8cf1-c55e0f152c3a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24502024-09-10T21:32:18.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b1d2995a-4a2b-4d2d-a776-9968e54c86d9 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24512024-09-10T21:32:18.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b1d2995a-4a2b-4d2d-a776-9968e54c86d9 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24522024-09-10T21:32:18.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b1d2995a-4a2b-4d2d-a776-9968e54c86d9 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24532024-09-10T21:32:18.965ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1370 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 5db2f06b-33e6-4bb7-a570-56bdb85e04e7 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
24542024-09-10T21:32:19.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 373c4daa-d27d-4879-bb83-d69d11a9f3d7 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24552024-09-10T21:32:19.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 373c4daa-d27d-4879-bb83-d69d11a9f3d7 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24562024-09-10T21:32:19.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 373c4daa-d27d-4879-bb83-d69d11a9f3d7 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24572024-09-10T21:32:19.568ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:64296
24582024-09-10T21:32:19.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64296 req_id = 3e926840-5436-4a9b-a598-a54ab973ddaa roles = RoleSet { roles: {} } uri = /metrics/producers
24592024-09-10T21:32:19.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64296 req_id = 3e926840-5436-4a9b-a598-a54ab973ddaa resource = Database result = Ok(()) uri = /metrics/producers
24602024-09-10T21:32:19.602ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
24612024-09-10T21:32:19.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64296 req_id = 3e926840-5436-4a9b-a598-a54ab973ddaa roles = RoleSet { roles: {} } uri = /metrics/producers
24622024-09-10T21:32:19.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64296 req_id = 3e926840-5436-4a9b-a598-a54ab973ddaa resource = Database result = Ok(()) uri = /metrics/producers
24632024-09-10T21:32:19.613ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
24642024-09-10T21:32:19.613ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fc3d865e-8805-4897-a91d-d78c1f35326c", "date": "Tue, 10 Sep 2024 21:32:19 GMT"} })
24652024-09-10T21:32:19.613ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = d81569f0-e466-416d-b609-21e92cc79ae5
24662024-09-10T21:32:19.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 47201 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64296 req_id = 3e926840-5436-4a9b-a598-a54ab973ddaa response_code = 201 uri = /metrics/producers
24672024-09-10T21:32:20.091ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54039
24682024-09-10T21:32:20.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54039 req_id = c8e5aa9c-caba-4851-87cf-98ef8daffec7 roles = RoleSet { roles: {} } uri = /metrics/producers
24692024-09-10T21:32:20.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54039 req_id = c8e5aa9c-caba-4851-87cf-98ef8daffec7 resource = Database result = Ok(()) uri = /metrics/producers
24702024-09-10T21:32:20.124ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
24712024-09-10T21:32:20.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54039 req_id = c8e5aa9c-caba-4851-87cf-98ef8daffec7 roles = RoleSet { roles: {} } uri = /metrics/producers
24722024-09-10T21:32:20.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54039 req_id = c8e5aa9c-caba-4851-87cf-98ef8daffec7 resource = Database result = Ok(()) uri = /metrics/producers
24732024-09-10T21:32:20.158ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
24742024-09-10T21:32:20.158ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6ca434d5-5568-4357-9cbd-8cd82c2ebfbf", "date": "Tue, 10 Sep 2024 21:32:19 GMT"} })
24752024-09-10T21:32:20.158ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 5bda5bf6-d58a-42d9-ba02-f35d66549de5
24762024-09-10T21:32:20.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68235 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54039 req_id = c8e5aa9c-caba-4851-87cf-98ef8daffec7 response_code = 201 uri = /metrics/producers
24772024-09-10T21:32:20.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 05046d5e-649a-4f6d-8ddb-49c082aff4f2 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24782024-09-10T21:32:20.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 05046d5e-649a-4f6d-8ddb-49c082aff4f2 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24792024-09-10T21:32:20.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 05046d5e-649a-4f6d-8ddb-49c082aff4f2 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24802024-09-10T21:32:21.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e9737126-916b-42f6-85fd-f0dcf5087137 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24812024-09-10T21:32:21.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e9737126-916b-42f6-85fd-f0dcf5087137 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24822024-09-10T21:32:21.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e9737126-916b-42f6-85fd-f0dcf5087137 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24832024-09-10T21:32:22.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = df755f22-c0e4-4d5d-9171-612444fdb085 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24842024-09-10T21:32:22.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = df755f22-c0e4-4d5d-9171-612444fdb085 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24852024-09-10T21:32:22.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = df755f22-c0e4-4d5d-9171-612444fdb085 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24862024-09-10T21:32:23.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ced37df9-492b-44aa-9b7b-458a8cccc900 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24872024-09-10T21:32:23.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ced37df9-492b-44aa-9b7b-458a8cccc900 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24882024-09-10T21:32:23.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = ced37df9-492b-44aa-9b7b-458a8cccc900 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24892024-09-10T21:32:24.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 88f8182b-f232-4bc2-9b9b-0931dec419ba roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24902024-09-10T21:32:24.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 88f8182b-f232-4bc2-9b9b-0931dec419ba resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24912024-09-10T21:32:24.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 88f8182b-f232-4bc2-9b9b-0931dec419ba response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24922024-09-10T21:32:25.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b267b668-2da2-4519-b37c-beb21a2c6a27 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24932024-09-10T21:32:25.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b267b668-2da2-4519-b37c-beb21a2c6a27 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24942024-09-10T21:32:25.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b267b668-2da2-4519-b37c-beb21a2c6a27 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
24952024-09-10T21:32:25.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
24962024-09-10T21:32:25.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24972024-09-10T21:32:25.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24982024-09-10T21:32:25.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
24992024-09-10T21:32:25.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25002024-09-10T21:32:25.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25012024-09-10T21:32:25.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022024-09-10T21:32:25.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25032024-09-10T21:32:25.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25042024-09-10T21:32:25.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25052024-09-10T21:32:25.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25062024-09-10T21:32:25.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25072024-09-10T21:32:25.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.232044ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25082024-09-10T21:32:25.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25092024-09-10T21:32:25.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25102024-09-10T21:32:25.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25112024-09-10T21:32:25.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
25122024-09-10T21:32:25.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25132024-09-10T21:32:25.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25142024-09-10T21:32:25.805ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
25152024-09-10T21:32:25.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.500754ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
25162024-09-10T21:32:26.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dd7ac94c-e27d-4c94-8ecb-39940238d8cf roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25172024-09-10T21:32:26.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dd7ac94c-e27d-4c94-8ecb-39940238d8cf resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25182024-09-10T21:32:26.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dd7ac94c-e27d-4c94-8ecb-39940238d8cf response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25192024-09-10T21:32:27.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5a29e65e-d80c-40d9-b9c4-111dfeaa18aa roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25202024-09-10T21:32:27.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5a29e65e-d80c-40d9-b9c4-111dfeaa18aa resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25212024-09-10T21:32:27.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5a29e65e-d80c-40d9-b9c4-111dfeaa18aa response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25222024-09-10T21:32:27.769ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:48921
25232024-09-10T21:32:27.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48921 req_id = 482923b2-897c-4950-847e-d5f2ac72184a roles = RoleSet { roles: {} } uri = /metrics/producers
25242024-09-10T21:32:27.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48921 req_id = 482923b2-897c-4950-847e-d5f2ac72184a resource = Database result = Ok(()) uri = /metrics/producers
25252024-09-10T21:32:27.803ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
25262024-09-10T21:32:27.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48921 req_id = 482923b2-897c-4950-847e-d5f2ac72184a roles = RoleSet { roles: {} } uri = /metrics/producers
25272024-09-10T21:32:27.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48921 req_id = 482923b2-897c-4950-847e-d5f2ac72184a resource = Database result = Ok(()) uri = /metrics/producers
25282024-09-10T21:32:27.837ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
25292024-09-10T21:32:27.838ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6d3710cf-be25-4fc0-a312-4670f4d4c855", "date": "Tue, 10 Sep 2024 21:32:27 GMT"} })
25302024-09-10T21:32:27.838ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 403254df-bc94-46d0-9b33-45b17d93603a
25312024-09-10T21:32:27.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69665 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48921 req_id = 482923b2-897c-4950-847e-d5f2ac72184a response_code = 201 uri = /metrics/producers
25322024-09-10T21:32:28.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5391d84e-ec6e-4f61-bd41-3204f52cac33 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25332024-09-10T21:32:28.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5391d84e-ec6e-4f61-bd41-3204f52cac33 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25342024-09-10T21:32:28.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5391d84e-ec6e-4f61-bd41-3204f52cac33 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25352024-09-10T21:32:28.966ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1389 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = faa55e38-d0d1-48f9-a21f-dde19165d114 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
25362024-09-10T21:32:29.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 949dce50-ec67-42fb-82c1-977b6776c3eb roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25372024-09-10T21:32:29.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 949dce50-ec67-42fb-82c1-977b6776c3eb resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25382024-09-10T21:32:29.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 949dce50-ec67-42fb-82c1-977b6776c3eb response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25392024-09-10T21:32:30.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 177546b0-5b4e-401a-8908-418f43066851 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25402024-09-10T21:32:30.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 177546b0-5b4e-401a-8908-418f43066851 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25412024-09-10T21:32:30.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 177546b0-5b4e-401a-8908-418f43066851 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25422024-09-10T21:32:31.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6323d191-9308-4bd5-bb95-a9e866c53c7e roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25432024-09-10T21:32:31.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6323d191-9308-4bd5-bb95-a9e866c53c7e resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25442024-09-10T21:32:31.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6323d191-9308-4bd5-bb95-a9e866c53c7e response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25452024-09-10T21:32:32.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 01722a66-8845-4786-b6f2-ebd8595811b8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25462024-09-10T21:32:32.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 01722a66-8845-4786-b6f2-ebd8595811b8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25472024-09-10T21:32:32.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 01722a66-8845-4786-b6f2-ebd8595811b8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25482024-09-10T21:32:33.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eac1bb37-8436-4148-984e-ac5164c1362b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25492024-09-10T21:32:33.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eac1bb37-8436-4148-984e-ac5164c1362b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25502024-09-10T21:32:33.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = eac1bb37-8436-4148-984e-ac5164c1362b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25512024-09-10T21:32:34.170ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:45701
25522024-09-10T21:32:34.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45701 req_id = 71c2c7fe-51d4-449c-93e1-9bebfa48812a roles = RoleSet { roles: {} } uri = /metrics/producers
25532024-09-10T21:32:34.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45701 req_id = 71c2c7fe-51d4-449c-93e1-9bebfa48812a resource = Database result = Ok(()) uri = /metrics/producers
25542024-09-10T21:32:34.202ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
25552024-09-10T21:32:34.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45701 req_id = 71c2c7fe-51d4-449c-93e1-9bebfa48812a roles = RoleSet { roles: {} } uri = /metrics/producers
25562024-09-10T21:32:34.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45701 req_id = 71c2c7fe-51d4-449c-93e1-9bebfa48812a resource = Database result = Ok(()) uri = /metrics/producers
25572024-09-10T21:32:34.208ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
25582024-09-10T21:32:34.209ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e400912b-cfe2-4348-8207-a4cbf7727028", "date": "Tue, 10 Sep 2024 21:32:34 GMT"} })
25592024-09-10T21:32:34.209ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 05f422ab-efd1-4f45-9453-f93ccaaaff0f
25602024-09-10T21:32:34.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39455 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45701 req_id = 71c2c7fe-51d4-449c-93e1-9bebfa48812a response_code = 201 uri = /metrics/producers
25612024-09-10T21:32:34.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 94c2f444-57c3-4d6d-aa55-6f3f464e8fb5 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25622024-09-10T21:32:34.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 94c2f444-57c3-4d6d-aa55-6f3f464e8fb5 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25632024-09-10T21:32:34.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 94c2f444-57c3-4d6d-aa55-6f3f464e8fb5 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25642024-09-10T21:32:35.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 264df9a5-5205-4676-80d9-26e9faccabe6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25652024-09-10T21:32:35.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 264df9a5-5205-4676-80d9-26e9faccabe6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25662024-09-10T21:32:35.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 264df9a5-5205-4676-80d9-26e9faccabe6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
25672024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
25682024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
25692024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
25702024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
25712024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25722024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25732024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
25742024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
25752024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
25762024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
25772024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25782024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25792024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25802024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
25812024-09-10T21:32:35.764ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f
25822024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
25832024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.341\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f"}
25842024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
25852024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
25862024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25872024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
25882024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25892024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
25902024-09-10T21:32:35.764ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
25912024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
25922024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25932024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25942024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
25952024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
25962024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25972024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
25982024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25992024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
26002024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26012024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
26022024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
26032024-09-10T21:32:35.764ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-10 21:22:35.764777932 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
26042024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
26052024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
26062024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26072024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
26082024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26092024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
26102024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26112024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26122024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
26132024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26142024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
26152024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26162024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
26172024-09-10T21:32:35.764ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
26182024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26192024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26202024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
26212024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
26222024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26232024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26242024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
26252024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26262024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26272024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26282024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26292024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26302024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26312024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26322024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26332024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26342024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26352024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26362024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26372024-09-10T21:32:35.765ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22ec8121-6583-4054-9535-d2454e5c4dec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2907, tv_nsec: 282740811 } })
26382024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26392024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26402024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26412024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26422024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26432024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26442024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26452024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26462024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26472024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26482024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26492024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
26502024-09-10T21:32:35.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26512024-09-10T21:32:35.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26522024-09-10T21:32:35.766ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48d3ebb5-3dc4-4b69-a505-4bb07f9482ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94337c1c-5cb5-4050-bd90-d4c50dd633f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2907, tv_nsec: 283844060 } })
26532024-09-10T21:32:35.767ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
26542024-09-10T21:32:35.767ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.688847ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
26552024-09-10T21:32:35.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26562024-09-10T21:32:35.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26572024-09-10T21:32:35.767ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26582024-09-10T21:32:35.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26592024-09-10T21:32:35.768ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
26602024-09-10T21:32:35.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.618353ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
26612024-09-10T21:32:35.769ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.649551ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26622024-09-10T21:32:35.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26632024-09-10T21:32:35.769ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26642024-09-10T21:32:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26652024-09-10T21:32:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26662024-09-10T21:32:35.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26672024-09-10T21:32:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26682024-09-10T21:32:35.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26692024-09-10T21:32:35.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26702024-09-10T21:32:35.773ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26712024-09-10T21:32:35.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2907, tv_nsec: 291463313 } })
26722024-09-10T21:32:35.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26732024-09-10T21:32:35.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26742024-09-10T21:32:35.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26752024-09-10T21:32:35.774ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-10 21:22:35.764777932 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
26762024-09-10T21:32:35.774ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.946803ms iteration = 9 status = {"expiration":"2024-09-10T21:22:35.764777932Z","pruned":[]}
26772024-09-10T21:32:35.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
26782024-09-10T21:32:35.775ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2907, tv_nsec: 292854027 } })
26792024-09-10T21:32:35.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
26802024-09-10T21:32:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26812024-09-10T21:32:35.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26822024-09-10T21:32:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
26832024-09-10T21:32:35.776ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26842024-09-10T21:32:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26852024-09-10T21:32:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26862024-09-10T21:32:35.782ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.535566ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
26872024-09-10T21:32:35.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26882024-09-10T21:32:35.790ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26892024-09-10T21:32:35.790ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2907, tv_nsec: 308123604 } })
26902024-09-10T21:32:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26912024-09-10T21:32:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26922024-09-10T21:32:35.792ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
26932024-09-10T21:32:35.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26942024-09-10T21:32:35.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26952024-09-10T21:32:35.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26962024-09-10T21:32:35.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26972024-09-10T21:32:35.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26982024-09-10T21:32:35.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26992024-09-10T21:32:35.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27002024-09-10T21:32:35.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27012024-09-10T21:32:35.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27022024-09-10T21:32:35.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27032024-09-10T21:32:35.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27042024-09-10T21:32:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27052024-09-10T21:32:35.815ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
27062024-09-10T21:32:35.815ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27072024-09-10T21:32:35.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27082024-09-10T21:32:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27092024-09-10T21:32:35.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27102024-09-10T21:32:35.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27112024-09-10T21:32:35.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27122024-09-10T21:32:35.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27132024-09-10T21:32:35.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27142024-09-10T21:32:35.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27152024-09-10T21:32:35.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27162024-09-10T21:32:35.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.071303ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
27172024-09-10T21:32:35.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27182024-09-10T21:32:35.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27192024-09-10T21:32:35.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27202024-09-10T21:32:35.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27212024-09-10T21:32:35.827ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27222024-09-10T21:32:35.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27232024-09-10T21:32:35.827ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27242024-09-10T21:32:35.827ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27252024-09-10T21:32:35.827ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.720074ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27262024-09-10T21:32:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27272024-09-10T21:32:35.828ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27282024-09-10T21:32:35.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27292024-09-10T21:32:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27302024-09-10T21:32:35.829ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27312024-09-10T21:32:35.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27322024-09-10T21:32:35.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27332024-09-10T21:32:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27342024-09-10T21:32:35.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27352024-09-10T21:32:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27362024-09-10T21:32:35.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27372024-09-10T21:32:35.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27382024-09-10T21:32:35.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27392024-09-10T21:32:35.836ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27402024-09-10T21:32:35.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.023816ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27412024-09-10T21:32:35.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.585646ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
27422024-09-10T21:32:35.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27432024-09-10T21:32:35.838ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 74.099893ms iteration = 20 status = {"physical_disks_added":0}
27442024-09-10T21:32:35.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27452024-09-10T21:32:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27462024-09-10T21:32:35.841ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27472024-09-10T21:32:35.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27482024-09-10T21:32:35.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27492024-09-10T21:32:35.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27502024-09-10T21:32:35.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
27512024-09-10T21:32:35.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27522024-09-10T21:32:35.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27532024-09-10T21:32:35.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27542024-09-10T21:32:35.848ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
27552024-09-10T21:32:35.848ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
27562024-09-10T21:32:35.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27572024-09-10T21:32:35.848ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.224879ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
27582024-09-10T21:32:35.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27592024-09-10T21:32:35.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
27602024-09-10T21:32:35.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27612024-09-10T21:32:35.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27622024-09-10T21:32:35.858ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.615413ms iteration = 17 status = 0
27632024-09-10T21:32:35.858ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
27642024-09-10T21:32:35.858ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.201024ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
27652024-09-10T21:32:35.863ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
27662024-09-10T21:32:35.863ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27672024-09-10T21:32:35.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27682024-09-10T21:32:35.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27692024-09-10T21:32:35.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 101.270287ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
27702024-09-10T21:32:35.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.057873ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27712024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.079634ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27722024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27732024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27742024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27752024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27762024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
27772024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
27782024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
27792024-09-10T21:32:35.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27802024-09-10T21:32:35.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27812024-09-10T21:32:35.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27822024-09-10T21:32:35.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27832024-09-10T21:32:35.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 110.228263ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27842024-09-10T21:32:35.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27852024-09-10T21:32:35.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27862024-09-10T21:32:35.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27872024-09-10T21:32:35.875ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
27882024-09-10T21:32:35.877ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
27892024-09-10T21:32:35.877ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
27902024-09-10T21:32:35.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27912024-09-10T21:32:35.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27922024-09-10T21:32:35.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932024-09-10T21:32:35.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27942024-09-10T21:32:35.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27952024-09-10T21:32:35.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27962024-09-10T21:32:35.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27972024-09-10T21:32:35.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27982024-09-10T21:32:35.885ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
27992024-09-10T21:32:35.885ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
28002024-09-10T21:32:35.885ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-10 21:24:36.002618 UTC dns_group = internal generation = 1
28012024-09-10T21:32:35.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 120.519072ms iteration = 10 status = {"generation":1}
28022024-09-10T21:32:35.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28032024-09-10T21:32:35.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28042024-09-10T21:32:35.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28052024-09-10T21:32:35.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28062024-09-10T21:32:35.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28072024-09-10T21:32:35.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28082024-09-10T21:32:35.907ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
28092024-09-10T21:32:35.907ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28102024-09-10T21:32:35.907ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.312372ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
28112024-09-10T21:32:35.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122024-09-10T21:32:35.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28132024-09-10T21:32:35.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28142024-09-10T21:32:35.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28152024-09-10T21:32:35.922ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-10T21:24:32.656983Z, time_modified: 2024-09-10T21:24:32.656983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }) }
28162024-09-10T21:32:35.922ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.470057ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]}},"default_endpoint":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28172024-09-10T21:32:35.935ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
28182024-09-10T21:32:35.935ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28192024-09-10T21:32:35.935ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "053c661d-8106-4921-aeb8-5e3c44e49286", "content-length": "26", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} })
28202024-09-10T21:32:35.935ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28212024-09-10T21:32:35.937ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28222024-09-10T21:32:35.938ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28232024-09-10T21:32:35.939ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
28242024-09-10T21:32:35.939ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 0 version = 2
28252024-09-10T21:32:35.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28262024-09-10T21:32:35.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28272024-09-10T21:32:35.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
28282024-09-10T21:32:35.948ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28292024-09-10T21:32:35.949ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a57dc3f9-44d8-442b-8674-81f3daa4f740", "content-length": "26", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} })
28302024-09-10T21:32:35.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28312024-09-10T21:32:35.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
28322024-09-10T21:32:35.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28332024-09-10T21:32:35.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28342024-09-10T21:32:35.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28352024-09-10T21:32:35.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28362024-09-10T21:32:35.972ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 1 version = 2
28372024-09-10T21:32:35.972ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28382024-09-10T21:32:35.972ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-10 21:24:37.242901 UTC dns_group = external generation = 2
28392024-09-10T21:32:35.972ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 207.741994ms iteration = 10 status = {"generation":2}
28402024-09-10T21:32:35.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28412024-09-10T21:32:35.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28422024-09-10T21:32:35.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28432024-09-10T21:32:35.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28442024-09-10T21:32:35.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28452024-09-10T21:32:35.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28462024-09-10T21:32:36.034ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28472024-09-10T21:32:36.035ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4b990bca-616d-454c-998f-b09bdc480f5b", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28482024-09-10T21:32:36.035ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28492024-09-10T21:32:36.038ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d955af17-503a-40b2-92e4-8fdc719f11e7", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28502024-09-10T21:32:36.038ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28512024-09-10T21:32:36.040ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28522024-09-10T21:32:36.040ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 275.470806ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28532024-09-10T21:32:36.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542024-09-10T21:32:36.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28552024-09-10T21:32:36.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28562024-09-10T21:32:36.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28572024-09-10T21:32:36.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28582024-09-10T21:32:36.071ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "985a989f-936f-4dfb-9af0-5a7fa376d02e", "content-length": "372", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} })
28592024-09-10T21:32:36.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28602024-09-10T21:32:36.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28612024-09-10T21:32:36.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28622024-09-10T21:32:36.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28632024-09-10T21:32:36.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28642024-09-10T21:32:36.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28652024-09-10T21:32:36.083ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28662024-09-10T21:32:36.084ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e8a36872-a12b-4d0f-bf6d-68da1e2eed14", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} })
28672024-09-10T21:32:36.087ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 322.186361ms iteration = 19 status = {}
28682024-09-10T21:32:36.107ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
28692024-09-10T21:32:36.107ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28702024-09-10T21:32:36.107ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "649e6235-2d0a-49b5-bf66-cfb6b8dd21fb", "content-length": "26", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} })
28712024-09-10T21:32:36.107ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28722024-09-10T21:32:36.109ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28732024-09-10T21:32:36.169ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28742024-09-10T21:32:36.204ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28752024-09-10T21:32:36.205ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4db9ee7-bb06-4e63-930d-4054826a232e", "content-length": "2", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} })
28762024-09-10T21:32:36.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28772024-09-10T21:32:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28782024-09-10T21:32:36.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28792024-09-10T21:32:36.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "011e0f9c-0b93-4ee7-9c7e-3902ea721e8a", "content-length": "691", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} })
28802024-09-10T21:32:36.255ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28812024-09-10T21:32:36.255ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28822024-09-10T21:32:36.255ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28832024-09-10T21:32:36.257ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 492.577284ms iteration = 17 status = {}
28842024-09-10T21:32:36.257ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 493.023062ms iteration = 17 status = null
28852024-09-10T21:32:36.258ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.273806ms iteration = 18 status = {}
28862024-09-10T21:32:36.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
28872024-09-10T21:32:36.277ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1bb8c0c6-5af2-479c-a3f5-b0d8ae2dd959", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28882024-09-10T21:32:36.277ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28892024-09-10T21:32:36.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "759a5cc8-0d63-429b-877f-cda566dada6b", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28902024-09-10T21:32:36.280ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28912024-09-10T21:32:36.281ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ec80327c-5fb1-4b21-8095-e393d833be00", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28922024-09-10T21:32:36.281ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28932024-09-10T21:32:36.283ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28942024-09-10T21:32:36.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 519.25593ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
28952024-09-10T21:32:36.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28962024-09-10T21:32:36.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28972024-09-10T21:32:36.325ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
28982024-09-10T21:32:36.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28992024-09-10T21:32:36.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29002024-09-10T21:32:36.337ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29012024-09-10T21:32:36.337ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "910af9fb-d2a0-4cd7-9204-470215b4cba6", "content-length": "121", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} })
29022024-09-10T21:32:36.337ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
29032024-09-10T21:32:36.337ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
29042024-09-10T21:32:36.338ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29052024-09-10T21:32:36.338ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29062024-09-10T21:32:36.338ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
29072024-09-10T21:32:36.338ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
29082024-09-10T21:32:36.338ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
29092024-09-10T21:32:36.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29102024-09-10T21:32:36.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29112024-09-10T21:32:36.339ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29122024-09-10T21:32:36.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "142ec2b9-0dd9-40a7-95a3-205788118f96", "content-length": "2", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} })
29132024-09-10T21:32:36.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29142024-09-10T21:32:36.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "294c9bab-0aa6-4a13-aa51-94b63af3114a", "content-length": "52", "date": "Tue, 10 Sep 2024 21:32:35 GMT"} })
29152024-09-10T21:32:36.340ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
29162024-09-10T21:32:36.340ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29172024-09-10T21:32:36.456ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "49123cd8-2d05-4ee1-8a54-026c87c1525d", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} })
29182024-09-10T21:32:36.456ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
29192024-09-10T21:32:36.456ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29202024-09-10T21:32:36.457ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e8ce620-a97d-4f6a-bd4d-aba8b307da65", "content-length": "667", "date": "Tue, 10 Sep 2024 21:32:36 GMT"} })
29212024-09-10T21:32:36.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29222024-09-10T21:32:36.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29232024-09-10T21:32:36.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29242024-09-10T21:32:36.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29252024-09-10T21:32:36.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29262024-09-10T21:32:36.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29272024-09-10T21:32:36.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29282024-09-10T21:32:36.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29292024-09-10T21:32:36.476ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 711.504034ms iteration = 17 status = {}
29302024-09-10T21:32:36.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 34fbe592-2a36-4955-af6b-ca0d3f4bfc65 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29312024-09-10T21:32:36.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 34fbe592-2a36-4955-af6b-ca0d3f4bfc65 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29322024-09-10T21:32:36.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 34fbe592-2a36-4955-af6b-ca0d3f4bfc65 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29332024-09-10T21:32:37.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 24a8a590-d932-4c1b-a942-d9e180513524 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29342024-09-10T21:32:37.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 24a8a590-d932-4c1b-a942-d9e180513524 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29352024-09-10T21:32:37.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 24a8a590-d932-4c1b-a942-d9e180513524 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29362024-09-10T21:32:38.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 19409af9-543e-4b64-a047-656b1a3a8e98 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29372024-09-10T21:32:38.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 19409af9-543e-4b64-a047-656b1a3a8e98 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29382024-09-10T21:32:38.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 19409af9-543e-4b64-a047-656b1a3a8e98 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29392024-09-10T21:32:38.965ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 2742884b-e88d-4c10-86bc-5514a6850c81 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
29402024-09-10T21:32:39.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fff1ba62-c32b-4d06-8fe4-27eb51d6cbc9 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29412024-09-10T21:32:39.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fff1ba62-c32b-4d06-8fe4-27eb51d6cbc9 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29422024-09-10T21:32:39.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = fff1ba62-c32b-4d06-8fe4-27eb51d6cbc9 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29432024-09-10T21:32:40.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 73d93c20-7a95-4c1a-acd4-ce59863b1ec8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29442024-09-10T21:32:40.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 73d93c20-7a95-4c1a-acd4-ce59863b1ec8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29452024-09-10T21:32:40.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 73d93c20-7a95-4c1a-acd4-ce59863b1ec8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29462024-09-10T21:32:40.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 1d3fc7a1-e40d-4d40-955f-b46b2ee16e2c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
29472024-09-10T21:32:40.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 1d3fc7a1-e40d-4d40-955f-b46b2ee16e2c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
29482024-09-10T21:32:40.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 1d3fc7a1-e40d-4d40-955f-b46b2ee16e2c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
29492024-09-10T21:32:41.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c9c14a49-a627-43fc-a8e7-16c3ba22fd17 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29502024-09-10T21:32:41.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c9c14a49-a627-43fc-a8e7-16c3ba22fd17 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29512024-09-10T21:32:41.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c9c14a49-a627-43fc-a8e7-16c3ba22fd17 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29522024-09-10T21:32:42.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 91d927df-9513-4e4e-b4bc-42d6f01457da roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29532024-09-10T21:32:42.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 91d927df-9513-4e4e-b4bc-42d6f01457da resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29542024-09-10T21:32:42.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 91d927df-9513-4e4e-b4bc-42d6f01457da response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29552024-09-10T21:32:42.957ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60943
29562024-09-10T21:32:42.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60943 req_id = a4301302-50c7-4f6c-8bd3-2e19aaf2395b roles = RoleSet { roles: {} } uri = /metrics/producers
29572024-09-10T21:32:42.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60943 req_id = a4301302-50c7-4f6c-8bd3-2e19aaf2395b resource = Database result = Ok(()) uri = /metrics/producers
29582024-09-10T21:32:42.991ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 392d3075-49c0-4f37-8684-de3f94e05aed
29592024-09-10T21:32:42.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60943 req_id = a4301302-50c7-4f6c-8bd3-2e19aaf2395b roles = RoleSet { roles: {} } uri = /metrics/producers
29602024-09-10T21:32:42.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60943 req_id = a4301302-50c7-4f6c-8bd3-2e19aaf2395b resource = Database result = Ok(()) uri = /metrics/producers
29612024-09-10T21:32:43.022ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed uri = http://[fd00:1122:3344:101::d]:12223/producers
29622024-09-10T21:32:43.022ZDEBGnexus: client response oximeter-collector = 392d3075-49c0-4f37-8684-de3f94e05aed result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "69e10a5a-ce6e-443a-8201-48f3e0cbbc33", "date": "Tue, 10 Sep 2024 21:32:43 GMT"} })
29632024-09-10T21:32:43.022ZINFOnexus: assigned collector to new producer collector_id = 392d3075-49c0-4f37-8684-de3f94e05aed file = nexus/src/app/oximeter.rs:125 producer_id = 0b27b808-f7c7-4497-bde3-8c612f81f39f
29642024-09-10T21:32:43.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66026 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60943 req_id = a4301302-50c7-4f6c-8bd3-2e19aaf2395b response_code = 201 uri = /metrics/producers
29652024-09-10T21:32:43.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e923b3a9-af97-4e4d-88c8-816df9552048 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29662024-09-10T21:32:43.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e923b3a9-af97-4e4d-88c8-816df9552048 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29672024-09-10T21:32:43.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e923b3a9-af97-4e4d-88c8-816df9552048 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29682024-09-10T21:32:44.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3416d8f3-d6f5-40ea-9907-a88c6e2f94a0 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29692024-09-10T21:32:44.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3416d8f3-d6f5-40ea-9907-a88c6e2f94a0 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29702024-09-10T21:32:44.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3416d8f3-d6f5-40ea-9907-a88c6e2f94a0 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29712024-09-10T21:32:45.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
29722024-09-10T21:32:45.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29732024-09-10T21:32:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29742024-09-10T21:32:45.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
29752024-09-10T21:32:45.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29762024-09-10T21:32:45.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29772024-09-10T21:32:45.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29782024-09-10T21:32:45.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29792024-09-10T21:32:45.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29802024-09-10T21:32:45.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29812024-09-10T21:32:45.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29822024-09-10T21:32:45.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29832024-09-10T21:32:45.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29842024-09-10T21:32:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29852024-09-10T21:32:45.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29862024-09-10T21:32:45.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
29872024-09-10T21:32:45.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29882024-09-10T21:32:45.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29892024-09-10T21:32:45.781ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
29902024-09-10T21:32:45.781ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.76103ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
29912024-09-10T21:32:45.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.1671ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29922024-09-10T21:32:45.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e30914ce-91f0-47ab-a449-15a847f5ae3c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29932024-09-10T21:32:45.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e30914ce-91f0-47ab-a449-15a847f5ae3c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29942024-09-10T21:32:45.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e30914ce-91f0-47ab-a449-15a847f5ae3c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29952024-09-10T21:32:46.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 043c60d1-d30a-4f6e-be24-de5f930d8643 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29962024-09-10T21:32:46.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 043c60d1-d30a-4f6e-be24-de5f930d8643 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29972024-09-10T21:32:46.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 043c60d1-d30a-4f6e-be24-de5f930d8643 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29982024-09-10T21:32:47.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0efbed74-a342-4483-9b0c-cd4d46733554 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
29992024-09-10T21:32:47.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0efbed74-a342-4483-9b0c-cd4d46733554 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30002024-09-10T21:32:47.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0efbed74-a342-4483-9b0c-cd4d46733554 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30012024-09-10T21:32:48.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e9a6c27b-8bec-4050-b6d0-613a2812af73 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30022024-09-10T21:32:48.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e9a6c27b-8bec-4050-b6d0-613a2812af73 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30032024-09-10T21:32:48.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e9a6c27b-8bec-4050-b6d0-613a2812af73 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30042024-09-10T21:32:48.965ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1540 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 2eb1c7b2-bd5b-4f75-947c-20bd89c28b96 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
30052024-09-10T21:32:49.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8e1895c3-1176-4bae-89bf-fd20201ec428 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30062024-09-10T21:32:49.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8e1895c3-1176-4bae-89bf-fd20201ec428 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30072024-09-10T21:32:49.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8e1895c3-1176-4bae-89bf-fd20201ec428 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30082024-09-10T21:32:50.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c12b539c-8412-427e-92b7-51eb93f32e53 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30092024-09-10T21:32:50.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c12b539c-8412-427e-92b7-51eb93f32e53 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30102024-09-10T21:32:50.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c12b539c-8412-427e-92b7-51eb93f32e53 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30112024-09-10T21:32:51.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1df92875-b48e-4d70-bc88-1e49e2ff6ceb roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30122024-09-10T21:32:51.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1df92875-b48e-4d70-bc88-1e49e2ff6ceb resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30132024-09-10T21:32:51.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1df92875-b48e-4d70-bc88-1e49e2ff6ceb response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30142024-09-10T21:32:52.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 03f64844-4fc4-4de6-8e2d-31548bac7f69 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30152024-09-10T21:32:52.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 03f64844-4fc4-4de6-8e2d-31548bac7f69 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30162024-09-10T21:32:52.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 03f64844-4fc4-4de6-8e2d-31548bac7f69 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30172024-09-10T21:32:53.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7592971e-422c-47df-96b5-ed3475cd12e7 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30182024-09-10T21:32:53.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7592971e-422c-47df-96b5-ed3475cd12e7 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30192024-09-10T21:32:53.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7592971e-422c-47df-96b5-ed3475cd12e7 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30202024-09-10T21:32:55.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 221cccc9-3dfb-4414-bbe4-3cf794de6b88 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30212024-09-10T21:32:55.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 221cccc9-3dfb-4414-bbe4-3cf794de6b88 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30222024-09-10T21:32:55.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 221cccc9-3dfb-4414-bbe4-3cf794de6b88 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30232024-09-10T21:32:55.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
30242024-09-10T21:32:55.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30252024-09-10T21:32:55.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30262024-09-10T21:32:55.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
30272024-09-10T21:32:55.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30282024-09-10T21:32:55.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30292024-09-10T21:32:55.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302024-09-10T21:32:55.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30312024-09-10T21:32:55.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30322024-09-10T21:32:55.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30332024-09-10T21:32:55.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30342024-09-10T21:32:55.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30352024-09-10T21:32:55.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.984279ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30362024-09-10T21:32:55.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30372024-09-10T21:32:55.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30382024-09-10T21:32:55.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30392024-09-10T21:32:55.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
30402024-09-10T21:32:55.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30412024-09-10T21:32:55.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30422024-09-10T21:32:55.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
30432024-09-10T21:32:55.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.659705ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
30442024-09-10T21:32:56.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 52039283-c969-4c95-b724-8de76ffaec82 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30452024-09-10T21:32:56.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 52039283-c969-4c95-b724-8de76ffaec82 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30462024-09-10T21:32:56.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 52039283-c969-4c95-b724-8de76ffaec82 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30472024-09-10T21:32:57.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0266d14b-cad5-4750-b612-7b6574a05f18 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30482024-09-10T21:32:57.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0266d14b-cad5-4750-b612-7b6574a05f18 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30492024-09-10T21:32:57.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 0266d14b-cad5-4750-b612-7b6574a05f18 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30502024-09-10T21:32:58.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 29555445-db08-49bb-905f-727483cf985d roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30512024-09-10T21:32:58.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 29555445-db08-49bb-905f-727483cf985d resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30522024-09-10T21:32:58.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 29555445-db08-49bb-905f-727483cf985d response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30532024-09-10T21:32:58.965ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1377 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 50ac29cc-cee0-4005-9cc2-42f6ba40b240 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
30542024-09-10T21:32:59.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9708249a-1c83-4ad7-a6c9-c692edf5987a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30552024-09-10T21:32:59.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9708249a-1c83-4ad7-a6c9-c692edf5987a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30562024-09-10T21:32:59.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9708249a-1c83-4ad7-a6c9-c692edf5987a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30572024-09-10T21:33:00.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3e80f463-ee0d-4838-8074-94b66ee708b1 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30582024-09-10T21:33:00.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3e80f463-ee0d-4838-8074-94b66ee708b1 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30592024-09-10T21:33:00.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3e80f463-ee0d-4838-8074-94b66ee708b1 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30602024-09-10T21:33:01.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 469b2b1b-2f60-4b11-8ede-c58b895ed5ba roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30612024-09-10T21:33:01.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 469b2b1b-2f60-4b11-8ede-c58b895ed5ba resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30622024-09-10T21:33:01.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 469b2b1b-2f60-4b11-8ede-c58b895ed5ba response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30632024-09-10T21:33:02.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d30b19bd-8659-4fef-a014-87022915a4cd roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30642024-09-10T21:33:02.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d30b19bd-8659-4fef-a014-87022915a4cd resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30652024-09-10T21:33:02.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = d30b19bd-8659-4fef-a014-87022915a4cd response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30662024-09-10T21:33:03.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 80494e56-752e-4076-aa55-e40e5e838c31 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30672024-09-10T21:33:03.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 80494e56-752e-4076-aa55-e40e5e838c31 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30682024-09-10T21:33:03.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 80494e56-752e-4076-aa55-e40e5e838c31 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30692024-09-10T21:33:04.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 09e776bf-5425-47a0-802a-92aae4511bc2 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30702024-09-10T21:33:04.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 09e776bf-5425-47a0-802a-92aae4511bc2 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30712024-09-10T21:33:04.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 09e776bf-5425-47a0-802a-92aae4511bc2 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30722024-09-10T21:33:05.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 706e0251-6253-426c-9c47-ef0f8e779980 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30732024-09-10T21:33:05.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 706e0251-6253-426c-9c47-ef0f8e779980 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30742024-09-10T21:33:05.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 706e0251-6253-426c-9c47-ef0f8e779980 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
30752024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
30762024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30772024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
30782024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
30792024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30802024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30812024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
30822024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
30832024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30842024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30852024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
30862024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30872024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
30882024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
30892024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
30902024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30912024-09-10T21:33:05.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30922024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30932024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30942024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30952024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30962024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30972024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30982024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30992024-09-10T21:33:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31002024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
31012024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
31022024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31032024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31042024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
31052024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31062024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
31072024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31082024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
31092024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
31102024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31112024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31122024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
31132024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31142024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
31152024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31162024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31172024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31182024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31192024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31202024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31212024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31222024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31232024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31242024-09-10T21:33:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31252024-09-10T21:33:05.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31262024-09-10T21:33:05.767ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2937, tv_nsec: 284639814 } })
31272024-09-10T21:33:05.767ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
31282024-09-10T21:33:05.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2937, tv_nsec: 285916016 } })
31292024-09-10T21:33:05.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31302024-09-10T21:33:05.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
31312024-09-10T21:33:05.769ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.555397ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31322024-09-10T21:33:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31332024-09-10T21:33:05.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31342024-09-10T21:33:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31352024-09-10T21:33:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31362024-09-10T21:33:05.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31372024-09-10T21:33:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31382024-09-10T21:33:05.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31392024-09-10T21:33:05.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.624691ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
31402024-09-10T21:33:05.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31412024-09-10T21:33:05.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31422024-09-10T21:33:05.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31432024-09-10T21:33:05.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442024-09-10T21:33:05.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31452024-09-10T21:33:05.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31462024-09-10T21:33:05.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31472024-09-10T21:33:05.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31482024-09-10T21:33:05.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31492024-09-10T21:33:05.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31502024-09-10T21:33:05.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31512024-09-10T21:33:05.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522024-09-10T21:33:05.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
31532024-09-10T21:33:05.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31542024-09-10T21:33:05.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31552024-09-10T21:33:05.793ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
31562024-09-10T21:33:05.793ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.416834ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
31572024-09-10T21:33:05.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582024-09-10T21:33:05.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31592024-09-10T21:33:05.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31602024-09-10T21:33:05.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31612024-09-10T21:33:05.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31622024-09-10T21:33:05.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31632024-09-10T21:33:05.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31642024-09-10T21:33:05.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31652024-09-10T21:33:05.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31662024-09-10T21:33:05.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31672024-09-10T21:33:05.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31682024-09-10T21:33:05.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31692024-09-10T21:33:05.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31702024-09-10T21:33:05.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31712024-09-10T21:33:05.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31722024-09-10T21:33:05.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31732024-09-10T21:33:05.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31742024-09-10T21:33:05.803ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
31752024-09-10T21:33:05.803ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31762024-09-10T21:33:05.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31772024-09-10T21:33:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31782024-09-10T21:33:05.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31792024-09-10T21:33:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31802024-09-10T21:33:05.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31812024-09-10T21:33:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31822024-09-10T21:33:05.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.817254ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
31832024-09-10T21:33:05.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2937, tv_nsec: 322416453 } })
31842024-09-10T21:33:05.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
31852024-09-10T21:33:05.805ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
31862024-09-10T21:33:05.805ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31872024-09-10T21:33:05.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31882024-09-10T21:33:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31892024-09-10T21:33:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
31902024-09-10T21:33:05.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31912024-09-10T21:33:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31922024-09-10T21:33:05.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31932024-09-10T21:33:05.809ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 45.450983ms iteration = 18 status = 0
31942024-09-10T21:33:05.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31952024-09-10T21:33:05.809ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31962024-09-10T21:33:05.809ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 44.412535ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31972024-09-10T21:33:05.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31982024-09-10T21:33:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31992024-09-10T21:33:05.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32002024-09-10T21:33:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32012024-09-10T21:33:05.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32022024-09-10T21:33:05.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32032024-09-10T21:33:05.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32042024-09-10T21:33:05.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32052024-09-10T21:33:05.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.525301ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32062024-09-10T21:33:05.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32072024-09-10T21:33:05.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32082024-09-10T21:33:05.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.271529ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32092024-09-10T21:33:05.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.283827ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
32102024-09-10T21:33:05.842ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
32112024-09-10T21:33:05.842ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32122024-09-10T21:33:05.842ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.590473ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
32132024-09-10T21:33:05.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
32142024-09-10T21:33:05.866ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32152024-09-10T21:33:05.866ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1415b08a-dc4b-476e-8d89-e7cfe0b7809e", "content-length": "26", "date": "Tue, 10 Sep 2024 21:33:05 GMT"} })
32162024-09-10T21:33:05.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32172024-09-10T21:33:05.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32182024-09-10T21:33:05.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32192024-09-10T21:33:05.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32202024-09-10T21:33:05.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
32212024-09-10T21:33:05.905ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32222024-09-10T21:33:05.905ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cd70c1b7-0805-445b-b5bb-334887eada96", "content-length": "26", "date": "Tue, 10 Sep 2024 21:33:05 GMT"} })
32232024-09-10T21:33:05.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32242024-09-10T21:33:05.906ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.282873ms iteration = 21 status = {"physical_disks_added":0}
32252024-09-10T21:33:05.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32262024-09-10T21:33:05.969ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
32272024-09-10T21:33:05.969ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32282024-09-10T21:33:05.969ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7893576b-efc9-4b7c-9bba-794d1d24df20", "content-length": "26", "date": "Tue, 10 Sep 2024 21:33:05 GMT"} })
32292024-09-10T21:33:05.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32302024-09-10T21:33:05.972ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
32312024-09-10T21:33:06.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32322024-09-10T21:33:06.020ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e2155698-9c30-4cc6-bfc5-856c89fe8b2f", "content-length": "372", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32332024-09-10T21:33:06.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32342024-09-10T21:33:06.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32352024-09-10T21:33:06.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32362024-09-10T21:33:06.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32372024-09-10T21:33:06.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 260.538476ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
32382024-09-10T21:33:06.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32392024-09-10T21:33:06.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32402024-09-10T21:33:06.029ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32412024-09-10T21:33:06.029ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1352f1f6-28a8-4a7a-9a3c-a30e735f1fc3", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32422024-09-10T21:33:06.031ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.52709ms iteration = 20 status = {}
32432024-09-10T21:33:06.057ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 293.802986ms iteration = 18 status = {}
32442024-09-10T21:33:06.057ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32452024-09-10T21:33:06.058ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e42dfb11-f521-44f8-bdf9-6aa725fe0339", "content-length": "2", "date": "Tue, 10 Sep 2024 21:33:05 GMT"} })
32462024-09-10T21:33:06.059ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32472024-09-10T21:33:06.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32482024-09-10T21:33:06.062ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 298.214623ms iteration = 18 status = null
32492024-09-10T21:33:06.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32502024-09-10T21:33:06.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32512024-09-10T21:33:06.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32522024-09-10T21:33:06.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32532024-09-10T21:33:06.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32542024-09-10T21:33:06.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32552024-09-10T21:33:06.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32562024-09-10T21:33:06.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32572024-09-10T21:33:06.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32582024-09-10T21:33:06.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32592024-09-10T21:33:06.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32602024-09-10T21:33:06.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4f772cf3-d6c1-47b5-af1f-cba8ba427c65", "content-length": "691", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32612024-09-10T21:33:06.137ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32622024-09-10T21:33:06.137ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32632024-09-10T21:33:06.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32642024-09-10T21:33:06.138ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 374.544565ms iteration = 19 status = {}
32652024-09-10T21:33:06.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32662024-09-10T21:33:06.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32672024-09-10T21:33:06.174ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
32682024-09-10T21:33:06.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32692024-09-10T21:33:06.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32702024-09-10T21:33:06.184ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32712024-09-10T21:33:06.184ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "28187cf5-4b69-40d2-a76e-7bc430f25c37", "content-length": "121", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32722024-09-10T21:33:06.184ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
32732024-09-10T21:33:06.184ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
32742024-09-10T21:33:06.184ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32752024-09-10T21:33:06.184ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32762024-09-10T21:33:06.184ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
32772024-09-10T21:33:06.184ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
32782024-09-10T21:33:06.184ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
32792024-09-10T21:33:06.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32802024-09-10T21:33:06.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32812024-09-10T21:33:06.187ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32822024-09-10T21:33:06.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a031ea1-e3d6-4ebb-ba6e-6e327c0e17f3", "content-length": "2", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32832024-09-10T21:33:06.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32842024-09-10T21:33:06.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d09b9036-5b67-4093-bbfe-99020e527118", "content-length": "52", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32852024-09-10T21:33:06.188ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
32862024-09-10T21:33:06.188ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32872024-09-10T21:33:06.283ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cdf5a871-728d-4692-966c-c788df0be3a3", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32882024-09-10T21:33:06.283ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
32892024-09-10T21:33:06.283ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32902024-09-10T21:33:06.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1c116b61-d64c-4a1d-94f0-103b171c975b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
32912024-09-10T21:33:06.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1c116b61-d64c-4a1d-94f0-103b171c975b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
32922024-09-10T21:33:06.285ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87efba21-1b96-417a-be7d-4d03b772fdb4", "content-length": "667", "date": "Tue, 10 Sep 2024 21:33:06 GMT"} })
32932024-09-10T21:33:06.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32942024-09-10T21:33:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32952024-09-10T21:33:06.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1c116b61-d64c-4a1d-94f0-103b171c975b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
32962024-09-10T21:33:06.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32972024-09-10T21:33:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32982024-09-10T21:33:06.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32992024-09-10T21:33:06.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33002024-09-10T21:33:06.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33012024-09-10T21:33:06.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33022024-09-10T21:33:06.301ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 537.819664ms iteration = 18 status = {}
33032024-09-10T21:33:07.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 74f65c7f-fbc0-4a7f-bc30-28b97538bb44 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33042024-09-10T21:33:07.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 74f65c7f-fbc0-4a7f-bc30-28b97538bb44 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33052024-09-10T21:33:07.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 74f65c7f-fbc0-4a7f-bc30-28b97538bb44 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33062024-09-10T21:33:08.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ec25171-65f9-44ec-8581-337c2f12bae2 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33072024-09-10T21:33:08.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ec25171-65f9-44ec-8581-337c2f12bae2 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33082024-09-10T21:33:08.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ec25171-65f9-44ec-8581-337c2f12bae2 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33092024-09-10T21:33:08.966ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1437 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = b36ad0c3-1b10-45a4-951f-788718e96246 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
33102024-09-10T21:33:09.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7b770b1e-411c-46a1-9b6b-c5460b75da4f roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33112024-09-10T21:33:09.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7b770b1e-411c-46a1-9b6b-c5460b75da4f resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33122024-09-10T21:33:09.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7b770b1e-411c-46a1-9b6b-c5460b75da4f response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33132024-09-10T21:33:10.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 98e47da1-5e91-4928-bde2-79bc412d032b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33142024-09-10T21:33:10.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 98e47da1-5e91-4928-bde2-79bc412d032b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33152024-09-10T21:33:10.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 98e47da1-5e91-4928-bde2-79bc412d032b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33162024-09-10T21:33:10.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 592c3a19-5313-4453-8edc-00d0d430d818 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
33172024-09-10T21:33:10.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 592c3a19-5313-4453-8edc-00d0d430d818 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
33182024-09-10T21:33:10.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = 592c3a19-5313-4453-8edc-00d0d430d818 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
33192024-09-10T21:33:11.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5b7e1eb1-57bb-41da-979d-6ec5d8cee26d roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33202024-09-10T21:33:11.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5b7e1eb1-57bb-41da-979d-6ec5d8cee26d resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33212024-09-10T21:33:11.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5b7e1eb1-57bb-41da-979d-6ec5d8cee26d response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33222024-09-10T21:33:12.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 34937c2e-4393-4df2-8112-e9d129d47e83 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33232024-09-10T21:33:12.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 34937c2e-4393-4df2-8112-e9d129d47e83 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33242024-09-10T21:33:12.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 34937c2e-4393-4df2-8112-e9d129d47e83 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33252024-09-10T21:33:13.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e693b94b-4dd3-4694-acbe-d1d434ab6d07 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33262024-09-10T21:33:13.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e693b94b-4dd3-4694-acbe-d1d434ab6d07 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33272024-09-10T21:33:13.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e693b94b-4dd3-4694-acbe-d1d434ab6d07 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33282024-09-10T21:33:14.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e4ea3f27-17ff-443d-8479-7d80f26a99ee roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33292024-09-10T21:33:14.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e4ea3f27-17ff-443d-8479-7d80f26a99ee resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33302024-09-10T21:33:14.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e4ea3f27-17ff-443d-8479-7d80f26a99ee response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33312024-09-10T21:33:15.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 13c988b7-8add-49cc-9cbd-23dd7f29009b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33322024-09-10T21:33:15.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 13c988b7-8add-49cc-9cbd-23dd7f29009b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33332024-09-10T21:33:15.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 13c988b7-8add-49cc-9cbd-23dd7f29009b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33342024-09-10T21:33:15.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
33352024-09-10T21:33:15.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33362024-09-10T21:33:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33372024-09-10T21:33:15.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
33382024-09-10T21:33:15.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33392024-09-10T21:33:15.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33402024-09-10T21:33:15.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33412024-09-10T21:33:15.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33422024-09-10T21:33:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33432024-09-10T21:33:15.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.610653ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33442024-09-10T21:33:15.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33452024-09-10T21:33:15.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33462024-09-10T21:33:15.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33472024-09-10T21:33:15.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33482024-09-10T21:33:15.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33492024-09-10T21:33:15.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33502024-09-10T21:33:15.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
33512024-09-10T21:33:15.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33522024-09-10T21:33:15.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33532024-09-10T21:33:15.781ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
33542024-09-10T21:33:15.781ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.609829ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
33552024-09-10T21:33:16.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a4e3addd-433a-42fe-8632-4872b278f27c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33562024-09-10T21:33:16.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a4e3addd-433a-42fe-8632-4872b278f27c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33572024-09-10T21:33:16.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a4e3addd-433a-42fe-8632-4872b278f27c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33582024-09-10T21:33:17.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e93640c8-869b-417a-9b79-e7f14aa57658 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33592024-09-10T21:33:17.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e93640c8-869b-417a-9b79-e7f14aa57658 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33602024-09-10T21:33:17.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e93640c8-869b-417a-9b79-e7f14aa57658 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33612024-09-10T21:33:18.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ac65192-c0a1-46c3-a628-7b27b652fbd6 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33622024-09-10T21:33:18.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ac65192-c0a1-46c3-a628-7b27b652fbd6 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33632024-09-10T21:33:18.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 2ac65192-c0a1-46c3-a628-7b27b652fbd6 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33642024-09-10T21:33:18.966ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = 78a568b5-9638-4e4d-b3c1-9da63f5a3c90 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
33652024-09-10T21:33:19.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 638f5951-c780-438c-87f4-5334f53f24a7 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33662024-09-10T21:33:19.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 638f5951-c780-438c-87f4-5334f53f24a7 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33672024-09-10T21:33:19.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 638f5951-c780-438c-87f4-5334f53f24a7 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33682024-09-10T21:33:20.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 379a46f1-72d7-42f6-86ce-de14a026edb3 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33692024-09-10T21:33:20.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 379a46f1-72d7-42f6-86ce-de14a026edb3 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33702024-09-10T21:33:20.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 379a46f1-72d7-42f6-86ce-de14a026edb3 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33712024-09-10T21:33:21.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3e0638ad-a8af-45ae-8701-ea56f69640e8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33722024-09-10T21:33:21.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3e0638ad-a8af-45ae-8701-ea56f69640e8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33732024-09-10T21:33:21.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3e0638ad-a8af-45ae-8701-ea56f69640e8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33742024-09-10T21:33:22.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 15385f1b-ef5c-467b-b62d-4eee5246cf52 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33752024-09-10T21:33:22.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 15385f1b-ef5c-467b-b62d-4eee5246cf52 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33762024-09-10T21:33:22.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 15385f1b-ef5c-467b-b62d-4eee5246cf52 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33772024-09-10T21:33:23.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9ab682e9-a14d-40f6-80df-3f2b64728e4f roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33782024-09-10T21:33:23.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9ab682e9-a14d-40f6-80df-3f2b64728e4f resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33792024-09-10T21:33:23.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 9ab682e9-a14d-40f6-80df-3f2b64728e4f response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33802024-09-10T21:33:24.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e2245ed8-a13b-4988-9a82-66aaf1e79e4a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33812024-09-10T21:33:24.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e2245ed8-a13b-4988-9a82-66aaf1e79e4a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33822024-09-10T21:33:24.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = e2245ed8-a13b-4988-9a82-66aaf1e79e4a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33832024-09-10T21:33:25.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 35dfb2bb-f18e-4893-a9a0-e9a45a012a3f roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33842024-09-10T21:33:25.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 35dfb2bb-f18e-4893-a9a0-e9a45a012a3f resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33852024-09-10T21:33:25.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 11364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 35dfb2bb-f18e-4893-a9a0-e9a45a012a3f response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
33862024-09-10T21:33:25.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
33872024-09-10T21:33:25.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33882024-09-10T21:33:25.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33892024-09-10T21:33:25.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
33902024-09-10T21:33:25.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33912024-09-10T21:33:25.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33922024-09-10T21:33:25.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-09-10T21:33:25.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33942024-09-10T21:33:25.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33952024-09-10T21:33:25.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33962024-09-10T21:33:25.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33972024-09-10T21:33:25.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33982024-09-10T21:33:25.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33992024-09-10T21:33:25.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34002024-09-10T21:33:25.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012024-09-10T21:33:25.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
34022024-09-10T21:33:25.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34032024-09-10T21:33:25.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34042024-09-10T21:33:25.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
34052024-09-10T21:33:25.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.867079ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
34062024-09-10T21:33:25.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.604301ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34072024-09-10T21:33:26.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 87b6e3bc-0503-4540-bc00-91bead18b23d roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34082024-09-10T21:33:26.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 87b6e3bc-0503-4540-bc00-91bead18b23d resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34092024-09-10T21:33:26.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 87b6e3bc-0503-4540-bc00-91bead18b23d response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34102024-09-10T21:33:27.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1e246470-85d7-4234-98cb-4a398b0a60b5 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34112024-09-10T21:33:27.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1e246470-85d7-4234-98cb-4a398b0a60b5 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34122024-09-10T21:33:27.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 1e246470-85d7-4234-98cb-4a398b0a60b5 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34132024-09-10T21:33:28.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = de1c340f-8dad-40f9-aaa4-b6faf9c4a41f roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34142024-09-10T21:33:28.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = de1c340f-8dad-40f9-aaa4-b6faf9c4a41f resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34152024-09-10T21:33:28.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = de1c340f-8dad-40f9-aaa4-b6faf9c4a41f response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34162024-09-10T21:33:28.966ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = eae581bd-82ff-4777-9197-ec9aebbd64fe response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
34172024-09-10T21:33:29.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8ad17a0b-5840-4d40-ab72-7c708720aaf1 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34182024-09-10T21:33:29.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8ad17a0b-5840-4d40-ab72-7c708720aaf1 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34192024-09-10T21:33:29.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8ad17a0b-5840-4d40-ab72-7c708720aaf1 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34202024-09-10T21:33:30.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 46b10689-0772-49bd-b741-d75637202194 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34212024-09-10T21:33:30.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 46b10689-0772-49bd-b741-d75637202194 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34222024-09-10T21:33:30.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 46b10689-0772-49bd-b741-d75637202194 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34232024-09-10T21:33:31.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 04582786-fa97-47b4-9b88-75a4333a0aa0 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34242024-09-10T21:33:31.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 04582786-fa97-47b4-9b88-75a4333a0aa0 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34252024-09-10T21:33:31.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 04582786-fa97-47b4-9b88-75a4333a0aa0 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34262024-09-10T21:33:32.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 16abde9b-b27a-4eab-8a8f-dd7aa67bb28e roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34272024-09-10T21:33:32.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 16abde9b-b27a-4eab-8a8f-dd7aa67bb28e resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34282024-09-10T21:33:32.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 16abde9b-b27a-4eab-8a8f-dd7aa67bb28e response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34292024-09-10T21:33:33.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c3ad187b-bf72-4413-a068-8b0854431d7c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34302024-09-10T21:33:33.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c3ad187b-bf72-4413-a068-8b0854431d7c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34312024-09-10T21:33:33.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c3ad187b-bf72-4413-a068-8b0854431d7c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34322024-09-10T21:33:34.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6de7a5b9-aac1-4449-b0f9-375acee66033 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34332024-09-10T21:33:34.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6de7a5b9-aac1-4449-b0f9-375acee66033 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34342024-09-10T21:33:34.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6de7a5b9-aac1-4449-b0f9-375acee66033 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
34352024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
34362024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
34372024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34382024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
34392024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34402024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
34412024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
34422024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
34432024-09-10T21:33:35.764ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f
34442024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34452024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.65\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f"}
34462024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
34472024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
34482024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
34492024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
34502024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34512024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34522024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
34532024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34542024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
34552024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
34562024-09-10T21:33:35.764ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
34572024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34582024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34592024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
34602024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
34612024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
34622024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34632024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
34642024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34652024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
34662024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
34672024-09-10T21:33:35.764ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-10 21:23:35.764552136 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
34682024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
34692024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34702024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
34712024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34722024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
34732024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
34742024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34752024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34762024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34772024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34782024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34792024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34802024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34812024-09-10T21:33:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34822024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34832024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34842024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
34852024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34862024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34872024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
34882024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34892024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
34902024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34912024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34922024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
34932024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
34942024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34952024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34962024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34972024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34982024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
34992024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
35002024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
35012024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35022024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
35032024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35042024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35052024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35062024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
35072024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
35082024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35092024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35102024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35112024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35122024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35132024-09-10T21:33:35.765ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48d3ebb5-3dc4-4b69-a505-4bb07f9482ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94337c1c-5cb5-4050-bd90-d4c50dd633f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b8ae7144-e4b7-44d2-8d80-34bfd3575616.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2967, tv_nsec: 282458426 } })
35142024-09-10T21:33:35.765ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22ec8121-6583-4054-9535-d2454e5c4dec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efb05780-75dc-4711-84b3-13f5e729e36e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2967, tv_nsec: 282464126 } })
35152024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35162024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
35172024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35182024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
35192024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35202024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35212024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35222024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35232024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35242024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35252024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35262024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35272024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35282024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35292024-09-10T21:33:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35302024-09-10T21:33:35.766ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
35312024-09-10T21:33:35.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.522175ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
35322024-09-10T21:33:35.767ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
35332024-09-10T21:33:35.767ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.605405ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
35342024-09-10T21:33:35.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35352024-09-10T21:33:35.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35362024-09-10T21:33:35.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35372024-09-10T21:33:35.768ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.652384ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35382024-09-10T21:33:35.768ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392024-09-10T21:33:35.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2967, tv_nsec: 286100880 } })
35402024-09-10T21:33:35.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
35412024-09-10T21:33:35.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35422024-09-10T21:33:35.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35432024-09-10T21:33:35.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35442024-09-10T21:33:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35452024-09-10T21:33:35.770ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35462024-09-10T21:33:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35472024-09-10T21:33:35.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-09-10T21:33:35.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2967, tv_nsec: 290050228 } })
35492024-09-10T21:33:35.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35502024-09-10T21:33:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35512024-09-10T21:33:35.773ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-10 21:23:35.764552136 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
35522024-09-10T21:33:35.773ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.495909ms iteration = 10 status = {"expiration":"2024-09-10T21:23:35.764552136Z","pruned":[]}
35532024-09-10T21:33:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35542024-09-10T21:33:35.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35552024-09-10T21:33:35.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
35562024-09-10T21:33:35.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572024-09-10T21:33:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35582024-09-10T21:33:35.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592024-09-10T21:33:35.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35602024-09-10T21:33:35.776ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35612024-09-10T21:33:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35622024-09-10T21:33:35.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35632024-09-10T21:33:35.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35642024-09-10T21:33:35.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35652024-09-10T21:33:35.778ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35662024-09-10T21:33:35.778ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35672024-09-10T21:33:35.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35682024-09-10T21:33:35.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35692024-09-10T21:33:35.781ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35702024-09-10T21:33:35.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35712024-09-10T21:33:35.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35722024-09-10T21:33:35.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35732024-09-10T21:33:35.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35742024-09-10T21:33:35.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35752024-09-10T21:33:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
35762024-09-10T21:33:35.782ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35772024-09-10T21:33:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35782024-09-10T21:33:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35792024-09-10T21:33:35.783ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.698006ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
35802024-09-10T21:33:35.784ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
35812024-09-10T21:33:35.784ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35822024-09-10T21:33:35.784ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35832024-09-10T21:33:35.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.237976ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
35842024-09-10T21:33:35.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35852024-09-10T21:33:35.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35862024-09-10T21:33:35.785ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35872024-09-10T21:33:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35882024-09-10T21:33:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35892024-09-10T21:33:35.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35902024-09-10T21:33:35.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35912024-09-10T21:33:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35922024-09-10T21:33:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35932024-09-10T21:33:35.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35942024-09-10T21:33:35.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35952024-09-10T21:33:35.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962024-09-10T21:33:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35972024-09-10T21:33:35.790ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35982024-09-10T21:33:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35992024-09-10T21:33:35.790ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002024-09-10T21:33:35.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36012024-09-10T21:33:35.791ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2967, tv_nsec: 308407629 } })
36022024-09-10T21:33:35.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36032024-09-10T21:33:35.791ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
36042024-09-10T21:33:35.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36052024-09-10T21:33:35.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36062024-09-10T21:33:35.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36072024-09-10T21:33:35.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36082024-09-10T21:33:35.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36092024-09-10T21:33:35.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36102024-09-10T21:33:35.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36112024-09-10T21:33:35.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36122024-09-10T21:33:35.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36132024-09-10T21:33:35.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36142024-09-10T21:33:35.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36152024-09-10T21:33:35.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36162024-09-10T21:33:35.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36172024-09-10T21:33:35.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36182024-09-10T21:33:35.803ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 38.747116ms iteration = 5 status = {"nsuccess":5}
36192024-09-10T21:33:35.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36202024-09-10T21:33:35.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36212024-09-10T21:33:35.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36222024-09-10T21:33:35.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36232024-09-10T21:33:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36242024-09-10T21:33:35.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252024-09-10T21:33:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
36262024-09-10T21:33:35.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36272024-09-10T21:33:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36282024-09-10T21:33:35.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.39899ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
36292024-09-10T21:33:35.817ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36302024-09-10T21:33:35.817ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.614798ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36312024-09-10T21:33:35.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36322024-09-10T21:33:35.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36332024-09-10T21:33:35.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
36342024-09-10T21:33:35.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.930553ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
36352024-09-10T21:33:35.821ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
36362024-09-10T21:33:35.821ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
36372024-09-10T21:33:35.821ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.869312ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
36382024-09-10T21:33:35.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.799436ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
36392024-09-10T21:33:35.824ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36402024-09-10T21:33:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36412024-09-10T21:33:35.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36422024-09-10T21:33:35.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36432024-09-10T21:33:35.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.936943ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36442024-09-10T21:33:35.827ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
36452024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36462024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36472024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.238726ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36482024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36492024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
36502024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
36512024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
36522024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36532024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36542024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36552024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36562024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36572024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36582024-09-10T21:33:35.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36592024-09-10T21:33:35.829ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
36602024-09-10T21:33:35.829ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
36612024-09-10T21:33:35.829ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 65.29073ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
36622024-09-10T21:33:35.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36632024-09-10T21:33:35.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642024-09-10T21:33:35.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36652024-09-10T21:33:35.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662024-09-10T21:33:35.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36672024-09-10T21:33:35.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36682024-09-10T21:33:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36692024-09-10T21:33:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36702024-09-10T21:33:35.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36712024-09-10T21:33:35.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36722024-09-10T21:33:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36732024-09-10T21:33:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36742024-09-10T21:33:35.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36752024-09-10T21:33:35.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36762024-09-10T21:33:35.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36772024-09-10T21:33:35.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36782024-09-10T21:33:35.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36792024-09-10T21:33:35.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36802024-09-10T21:33:35.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36812024-09-10T21:33:35.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
36822024-09-10T21:33:35.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36832024-09-10T21:33:35.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36842024-09-10T21:33:35.850ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.238634ms iteration = 19 status = 0
36852024-09-10T21:33:35.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36862024-09-10T21:33:35.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36872024-09-10T21:33:35.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36882024-09-10T21:33:35.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36892024-09-10T21:33:35.872ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
36902024-09-10T21:33:35.872ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36912024-09-10T21:33:35.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.861582ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
36922024-09-10T21:33:35.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36932024-09-10T21:33:35.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36942024-09-10T21:33:35.874ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36952024-09-10T21:33:35.874ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36962024-09-10T21:33:35.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36972024-09-10T21:33:35.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36982024-09-10T21:33:35.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.868268ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36992024-09-10T21:33:35.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37002024-09-10T21:33:35.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37012024-09-10T21:33:35.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37022024-09-10T21:33:35.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37032024-09-10T21:33:35.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
37042024-09-10T21:33:35.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37052024-09-10T21:33:35.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37062024-09-10T21:33:35.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37072024-09-10T21:33:35.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37082024-09-10T21:33:35.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37092024-09-10T21:33:35.881ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 22488d0e-430a-47fa-bda3-26660a7303ec dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
37102024-09-10T21:33:35.881ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
37112024-09-10T21:33:35.881ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-10 21:24:36.002618 UTC dns_group = internal generation = 1
37122024-09-10T21:33:35.881ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 116.725746ms iteration = 11 status = {"generation":1}
37132024-09-10T21:33:35.881ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 117.464149ms iteration = 22 status = {"physical_disks_added":0}
37142024-09-10T21:33:35.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37152024-09-10T21:33:35.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37162024-09-10T21:33:35.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-09-10T21:33:35.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37182024-09-10T21:33:35.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37192024-09-10T21:33:35.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37202024-09-10T21:33:35.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37212024-09-10T21:33:35.895ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-10T21:24:32.656983Z, time_modified: 2024-09-10T21:24:32.656983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, db_silo: Silo { identity: SiloIdentity { id: 644a396e-dfc8-46ce-bf81-7b188fb4c5ae, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-10T21:24:37.197734Z, time_modified: 2024-09-10T21:24:37.197734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88" }] }) }
37222024-09-10T21:33:35.895ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
37232024-09-10T21:33:35.895ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 0 version = 2
37242024-09-10T21:33:35.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37252024-09-10T21:33:35.895ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 131.26332ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]}},"default_endpoint":{"silo_id":"644a396e-dfc8-46ce-bf81-7b188fb4c5ae","tls_certs":["98f3681e92fb0cefac815dafd816b3c78bd8af231618475f4824ea0f31bfed88"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37262024-09-10T21:33:35.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37272024-09-10T21:33:35.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37282024-09-10T21:33:35.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37292024-09-10T21:33:35.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37302024-09-10T21:33:35.919ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37312024-09-10T21:33:35.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
37322024-09-10T21:33:35.920ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37332024-09-10T21:33:35.921ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bee494fa-f0d6-45f8-baa4-d27969859042", "content-length": "26", "date": "Tue, 10 Sep 2024 21:33:35 GMT"} })
37342024-09-10T21:33:35.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37352024-09-10T21:33:35.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37362024-09-10T21:33:35.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c5f2016-a6c4-44a0-8bf0-dd6ee6787434 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
37372024-09-10T21:33:35.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c5f2016-a6c4-44a0-8bf0-dd6ee6787434 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
37382024-09-10T21:33:36.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
37392024-09-10T21:33:36.037ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37402024-09-10T21:33:36.037ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77c977ca-0639-4e74-aeb8-c4c46e8ab1d9", "content-length": "26", "date": "Tue, 10 Sep 2024 21:33:35 GMT"} })
37412024-09-10T21:33:36.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37422024-09-10T21:33:36.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
37432024-09-10T21:33:36.059ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37442024-09-10T21:33:36.099ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
37452024-09-10T21:33:36.099ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37462024-09-10T21:33:36.099ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8b4d5e56-644f-4398-a44b-deb3a44e0abe", "content-length": "26", "date": "Tue, 10 Sep 2024 21:33:35 GMT"} })
37472024-09-10T21:33:36.099ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37482024-09-10T21:33:36.103ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37492024-09-10T21:33:36.123ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37502024-09-10T21:33:36.123ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "303e3342-f2a8-4ccc-835a-be7bf93646fe", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37512024-09-10T21:33:36.123ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37522024-09-10T21:33:36.126ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a65fb9ae-71bc-4488-bb8f-cc40c7be035f", "date": "Tue, 10 Sep 2024 21:33:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37532024-09-10T21:33:36.126ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37542024-09-10T21:33:36.126ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 362.416813ms iteration = 19 status = {}
37552024-09-10T21:33:36.129ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37562024-09-10T21:33:36.129ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 365.302553ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37572024-09-10T21:33:36.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37582024-09-10T21:33:36.209ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8188202c-f29c-4217-a8ef-b58681799991", "content-length": "372", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
37592024-09-10T21:33:36.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37602024-09-10T21:33:36.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37612024-09-10T21:33:36.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37622024-09-10T21:33:36.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 264572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8c5f2016-a6c4-44a0-8bf0-dd6ee6787434 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
37632024-09-10T21:33:36.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37642024-09-10T21:33:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37652024-09-10T21:33:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37662024-09-10T21:33:36.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37672024-09-10T21:33:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37682024-09-10T21:33:36.216ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 741160cf-e21f-4985-adea-a5e14bda999a dns_zone_name = oxide.test found_so_far = 1 version = 2
37692024-09-10T21:33:36.216ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37702024-09-10T21:33:36.216ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-10 21:24:37.242901 UTC dns_group = external generation = 2
37712024-09-10T21:33:36.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 451.680061ms iteration = 11 status = {"generation":2}
37722024-09-10T21:33:36.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37732024-09-10T21:33:36.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37742024-09-10T21:33:36.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37752024-09-10T21:33:36.336ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37762024-09-10T21:33:36.336ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "231ba128-a88c-46e5-b924-ad1850cf40bb", "content-length": "691", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
37772024-09-10T21:33:36.336ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37782024-09-10T21:33:36.336ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37792024-09-10T21:33:36.336ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37802024-09-10T21:33:36.337ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 573.333883ms iteration = 20 status = {}
37812024-09-10T21:33:36.339ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37822024-09-10T21:33:36.339ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "22df57b9-e7d5-4c15-94cc-0a0916ebcb10", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
37832024-09-10T21:33:36.342ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 577.065479ms iteration = 21 status = {}
37842024-09-10T21:33:36.367ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37852024-09-10T21:33:36.367ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86308751-c950-4da2-bae2-d9e4d5beec45", "content-length": "2", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
37862024-09-10T21:33:36.368ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37872024-09-10T21:33:36.368ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "501f7bc8-fe6d-42f4-a947-359dadaaae88", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37882024-09-10T21:33:36.368ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37892024-09-10T21:33:36.369ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37902024-09-10T21:33:36.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37912024-09-10T21:33:36.370ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "986d4325-1b4c-42e9-a05c-541159c90a49", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37922024-09-10T21:33:36.370ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37932024-09-10T21:33:36.372ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 607.927907ms iteration = 19 status = null
37942024-09-10T21:33:36.372ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "32d45311-54c0-4256-9751-59efa707b65d", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37952024-09-10T21:33:36.372ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37962024-09-10T21:33:36.374ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37972024-09-10T21:33:36.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 610.467201ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37982024-09-10T21:33:36.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37992024-09-10T21:33:36.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38002024-09-10T21:33:36.438ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
38012024-09-10T21:33:36.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38022024-09-10T21:33:36.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38032024-09-10T21:33:36.448ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38042024-09-10T21:33:36.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2019f163-c5a9-4934-aa65-da9605e323c2", "content-length": "121", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
38052024-09-10T21:33:36.448ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
38062024-09-10T21:33:36.448ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
38072024-09-10T21:33:36.449ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38082024-09-10T21:33:36.449ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38092024-09-10T21:33:36.449ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
38102024-09-10T21:33:36.449ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
38112024-09-10T21:33:36.449ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
38122024-09-10T21:33:36.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38132024-09-10T21:33:36.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38142024-09-10T21:33:36.451ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38152024-09-10T21:33:36.451ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06239cd0-d0fc-4f6e-9013-50b2e89a8e6a", "content-length": "2", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
38162024-09-10T21:33:36.451ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38172024-09-10T21:33:36.451ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "81cffb7c-4143-4b73-a540-ca94f4912a28", "content-length": "52", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
38182024-09-10T21:33:36.451ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
38192024-09-10T21:33:36.451ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38202024-09-10T21:33:36.555ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "adb69cad-1f57-4c49-88c8-931dc891537f", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
38212024-09-10T21:33:36.555ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch = Switch0
38222024-09-10T21:33:36.555ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38232024-09-10T21:33:36.641ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd00d6ca-66f0-41cd-9321-b644308aa52a", "content-length": "667", "date": "Tue, 10 Sep 2024 21:33:36 GMT"} })
38242024-09-10T21:33:36.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38252024-09-10T21:33:36.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38262024-09-10T21:33:36.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38272024-09-10T21:33:36.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38282024-09-10T21:33:36.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38292024-09-10T21:33:36.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38302024-09-10T21:33:36.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38312024-09-10T21:33:36.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38322024-09-10T21:33:36.660ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 896.058294ms iteration = 19 status = {}
38332024-09-10T21:33:37.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b9789095-3f78-411f-9494-3241069d8513 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38342024-09-10T21:33:37.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b9789095-3f78-411f-9494-3241069d8513 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38352024-09-10T21:33:37.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b9789095-3f78-411f-9494-3241069d8513 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38362024-09-10T21:33:38.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 90522e17-d0a9-4dd9-adcb-b7db7b0f849a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38372024-09-10T21:33:38.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 90522e17-d0a9-4dd9-adcb-b7db7b0f849a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38382024-09-10T21:33:38.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 90522e17-d0a9-4dd9-adcb-b7db7b0f849a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38392024-09-10T21:33:38.966ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = bcd71538-183a-403b-acec-c55b13d393ed response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
38402024-09-10T21:33:39.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c83ffd2a-fd9d-4c74-a104-e3ec363efaae roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38412024-09-10T21:33:39.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c83ffd2a-fd9d-4c74-a104-e3ec363efaae resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38422024-09-10T21:33:39.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c83ffd2a-fd9d-4c74-a104-e3ec363efaae response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38432024-09-10T21:33:40.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7a31e2c6-85c6-4c7c-a6c7-43ecce6cd159 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38442024-09-10T21:33:40.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7a31e2c6-85c6-4c7c-a6c7-43ecce6cd159 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38452024-09-10T21:33:40.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 7a31e2c6-85c6-4c7c-a6c7-43ecce6cd159 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38462024-09-10T21:33:40.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = bf0764b9-a63d-48e4-a117-75f20c83ffbd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
38472024-09-10T21:33:40.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = bf0764b9-a63d-48e4-a117-75f20c83ffbd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
38482024-09-10T21:33:40.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59369 req_id = bf0764b9-a63d-48e4-a117-75f20c83ffbd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
38492024-09-10T21:33:41.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 88370d62-a1e2-460c-9d66-e336b1419682 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38502024-09-10T21:33:41.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 88370d62-a1e2-460c-9d66-e336b1419682 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38512024-09-10T21:33:41.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 88370d62-a1e2-460c-9d66-e336b1419682 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38522024-09-10T21:33:42.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 08c6a3aa-99a9-498a-bb3a-c8016a4c1721 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38532024-09-10T21:33:42.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 08c6a3aa-99a9-498a-bb3a-c8016a4c1721 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38542024-09-10T21:33:42.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 08c6a3aa-99a9-498a-bb3a-c8016a4c1721 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38552024-09-10T21:33:43.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f13fc433-188c-4bba-a9ba-172898efcacd roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38562024-09-10T21:33:43.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f13fc433-188c-4bba-a9ba-172898efcacd resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38572024-09-10T21:33:43.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f13fc433-188c-4bba-a9ba-172898efcacd response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38582024-09-10T21:33:44.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 10e9978d-846f-486d-b7be-43b656284ec2 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38592024-09-10T21:33:44.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 10e9978d-846f-486d-b7be-43b656284ec2 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38602024-09-10T21:33:44.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 10e9978d-846f-486d-b7be-43b656284ec2 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38612024-09-10T21:33:45.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 78e7aa87-5df0-4ced-ac2d-757fb2f1de96 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38622024-09-10T21:33:45.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 78e7aa87-5df0-4ced-ac2d-757fb2f1de96 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38632024-09-10T21:33:45.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 78e7aa87-5df0-4ced-ac2d-757fb2f1de96 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38642024-09-10T21:33:45.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
38652024-09-10T21:33:45.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38662024-09-10T21:33:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38672024-09-10T21:33:45.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
38682024-09-10T21:33:45.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38692024-09-10T21:33:45.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38702024-09-10T21:33:45.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38712024-09-10T21:33:45.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38722024-09-10T21:33:45.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38732024-09-10T21:33:45.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.222744ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38742024-09-10T21:33:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38752024-09-10T21:33:45.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38762024-09-10T21:33:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38772024-09-10T21:33:45.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38782024-09-10T21:33:45.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38792024-09-10T21:33:45.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38802024-09-10T21:33:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
38812024-09-10T21:33:45.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38822024-09-10T21:33:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38832024-09-10T21:33:45.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
38842024-09-10T21:33:45.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.848369ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
38852024-09-10T21:33:46.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3160b4ed-4c06-4f13-9ac1-1e2d54c8e45b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38862024-09-10T21:33:46.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3160b4ed-4c06-4f13-9ac1-1e2d54c8e45b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38872024-09-10T21:33:46.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3160b4ed-4c06-4f13-9ac1-1e2d54c8e45b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38882024-09-10T21:33:47.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 07634653-6e03-4cee-b395-c6695109439c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38892024-09-10T21:33:47.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 07634653-6e03-4cee-b395-c6695109439c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38902024-09-10T21:33:47.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 07634653-6e03-4cee-b395-c6695109439c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38912024-09-10T21:33:48.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d1a6a4b-306c-4a9c-bb4f-a0b322157423 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38922024-09-10T21:33:48.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d1a6a4b-306c-4a9c-bb4f-a0b322157423 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38932024-09-10T21:33:48.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 6d1a6a4b-306c-4a9c-bb4f-a0b322157423 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38942024-09-10T21:33:48.966ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = d52c5b91-280d-4e16-aef3-d03341e13855 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
38952024-09-10T21:33:49.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a3b98fd2-d870-4f55-9d22-5bbbd513b1f4 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38962024-09-10T21:33:49.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a3b98fd2-d870-4f55-9d22-5bbbd513b1f4 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38972024-09-10T21:33:49.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a3b98fd2-d870-4f55-9d22-5bbbd513b1f4 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38982024-09-10T21:33:50.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3295e913-f66b-4922-a644-4c6f2908185e roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
38992024-09-10T21:33:50.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3295e913-f66b-4922-a644-4c6f2908185e resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39002024-09-10T21:33:50.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 3295e913-f66b-4922-a644-4c6f2908185e response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39012024-09-10T21:33:51.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 82e677f6-88b2-471f-8a32-a66e5691de3e roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39022024-09-10T21:33:51.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 82e677f6-88b2-471f-8a32-a66e5691de3e resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39032024-09-10T21:33:51.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 82e677f6-88b2-471f-8a32-a66e5691de3e response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39042024-09-10T21:33:52.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b3bda8ff-bb99-452d-847d-a15af4b5ba86 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39052024-09-10T21:33:52.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b3bda8ff-bb99-452d-847d-a15af4b5ba86 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39062024-09-10T21:33:52.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b3bda8ff-bb99-452d-847d-a15af4b5ba86 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39072024-09-10T21:33:53.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c1d6130e-2b38-4c46-a5e5-aea97feeb60a roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39082024-09-10T21:33:53.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c1d6130e-2b38-4c46-a5e5-aea97feeb60a resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39092024-09-10T21:33:53.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = c1d6130e-2b38-4c46-a5e5-aea97feeb60a response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39102024-09-10T21:33:54.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5d4ed6ef-9d84-4dd1-8dd2-3493b7383d3c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39112024-09-10T21:33:54.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5d4ed6ef-9d84-4dd1-8dd2-3493b7383d3c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39122024-09-10T21:33:54.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 5d4ed6ef-9d84-4dd1-8dd2-3493b7383d3c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39132024-09-10T21:33:55.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 60047d4b-352f-4a8e-b475-49cab7f4eb10 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39142024-09-10T21:33:55.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 60047d4b-352f-4a8e-b475-49cab7f4eb10 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39152024-09-10T21:33:55.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 60047d4b-352f-4a8e-b475-49cab7f4eb10 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39162024-09-10T21:33:55.764ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
39172024-09-10T21:33:55.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
39182024-09-10T21:33:55.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39192024-09-10T21:33:55.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39202024-09-10T21:33:55.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39212024-09-10T21:33:55.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39222024-09-10T21:33:55.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232024-09-10T21:33:55.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39242024-09-10T21:33:55.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39252024-09-10T21:33:55.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39262024-09-10T21:33:55.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39272024-09-10T21:33:55.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39282024-09-10T21:33:55.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39292024-09-10T21:33:55.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39302024-09-10T21:33:55.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312024-09-10T21:33:55.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
39322024-09-10T21:33:55.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39332024-09-10T21:33:55.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39342024-09-10T21:33:55.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
39352024-09-10T21:33:55.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.416899ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
39362024-09-10T21:33:55.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.325632ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39372024-09-10T21:33:56.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8a194e10-9d75-4eed-a07b-02a7bdd7ab2c roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39382024-09-10T21:33:56.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8a194e10-9d75-4eed-a07b-02a7bdd7ab2c resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39392024-09-10T21:33:56.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 8a194e10-9d75-4eed-a07b-02a7bdd7ab2c response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39402024-09-10T21:33:57.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a0ed3ca3-0790-4674-af58-e1f6af7a5d33 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39412024-09-10T21:33:57.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a0ed3ca3-0790-4674-af58-e1f6af7a5d33 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39422024-09-10T21:33:57.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a0ed3ca3-0790-4674-af58-e1f6af7a5d33 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39432024-09-10T21:33:58.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b916d405-f4ae-4e50-8d8c-b3c11790d223 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39442024-09-10T21:33:58.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b916d405-f4ae-4e50-8d8c-b3c11790d223 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39452024-09-10T21:33:58.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = b916d405-f4ae-4e50-8d8c-b3c11790d223 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39462024-09-10T21:33:58.966ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1470 local_addr = [fd00:1122:3344:101::c]:58742 method = GET remote_addr = [fd00:1122:3344:101::d]:63280 req_id = d2f96cd1-17a1-40ca-8702-9e2608a824d9 response_code = 200 uri = /19a73de5-6a55-413b-9592-dba813ea235c
39472024-09-10T21:33:59.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a2e3daef-4ea6-4dc4-8aa5-8ab409a6f1f8 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39482024-09-10T21:33:59.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a2e3daef-4ea6-4dc4-8aa5-8ab409a6f1f8 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39492024-09-10T21:33:59.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = a2e3daef-4ea6-4dc4-8aa5-8ab409a6f1f8 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39502024-09-10T21:34:00.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dca4a868-acfd-4a94-a3fc-8b1646d7f50d roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39512024-09-10T21:34:00.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dca4a868-acfd-4a94-a3fc-8b1646d7f50d resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39522024-09-10T21:34:00.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = dca4a868-acfd-4a94-a3fc-8b1646d7f50d response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39532024-09-10T21:34:01.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 49fd259f-da8a-4478-8946-2fdbb0aa3555 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39542024-09-10T21:34:01.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 49fd259f-da8a-4478-8946-2fdbb0aa3555 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39552024-09-10T21:34:01.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 49fd259f-da8a-4478-8946-2fdbb0aa3555 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39562024-09-10T21:34:02.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = abe8a096-c352-47b0-a24c-f2c2433b924b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39572024-09-10T21:34:02.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = abe8a096-c352-47b0-a24c-f2c2433b924b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39582024-09-10T21:34:02.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = abe8a096-c352-47b0-a24c-f2c2433b924b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39592024-09-10T21:34:03.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f96204d1-256a-4a4c-876d-fca4de97b361 roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39602024-09-10T21:34:03.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f96204d1-256a-4a4c-876d-fca4de97b361 resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39612024-09-10T21:34:03.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f96204d1-256a-4a4c-876d-fca4de97b361 response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39622024-09-10T21:34:04.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 48701693-f3c9-4c01-9875-d7d6fd1d8b4b roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39632024-09-10T21:34:04.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 48701693-f3c9-4c01-9875-d7d6fd1d8b4b resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39642024-09-10T21:34:04.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = 48701693-f3c9-4c01-9875-d7d6fd1d8b4b response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
39652024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
39662024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
39672024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39682024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
39692024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39702024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39712024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
39722024-09-10T21:34:05.763ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
39732024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39742024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
39752024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
39762024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
39772024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39782024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39792024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39802024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
39812024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39822024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39832024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39842024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39852024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39862024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39872024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39882024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39892024-09-10T21:34:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39902024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
39912024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39922024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
39932024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39942024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39952024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
39962024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39972024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
39982024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
39992024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40002024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40012024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
40022024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40032024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
40042024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40052024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
40062024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40072024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40082024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40092024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40102024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40112024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40122024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40132024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40142024-09-10T21:34:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40152024-09-10T21:34:05.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-09-10T21:34:05.767ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.244737ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40172024-09-10T21:34:05.767ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2997, tv_nsec: 284766516 } })
40182024-09-10T21:34:05.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40192024-09-10T21:34:05.767ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
40202024-09-10T21:34:05.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40212024-09-10T21:34:05.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2997, tv_nsec: 286982105 } })
40222024-09-10T21:34:05.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40232024-09-10T21:34:05.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40242024-09-10T21:34:05.770ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
40252024-09-10T21:34:05.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40262024-09-10T21:34:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40272024-09-10T21:34:05.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40282024-09-10T21:34:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40292024-09-10T21:34:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40302024-09-10T21:34:05.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40312024-09-10T21:34:05.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322024-09-10T21:34:05.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40332024-09-10T21:34:05.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40342024-09-10T21:34:05.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40352024-09-10T21:34:05.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40362024-09-10T21:34:05.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40372024-09-10T21:34:05.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.871324ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
40382024-09-10T21:34:05.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40392024-09-10T21:34:05.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40402024-09-10T21:34:05.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412024-09-10T21:34:05.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40422024-09-10T21:34:05.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40432024-09-10T21:34:05.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40442024-09-10T21:34:05.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40452024-09-10T21:34:05.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40462024-09-10T21:34:05.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40472024-09-10T21:34:05.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40482024-09-10T21:34:05.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40492024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40502024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40512024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40522024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40532024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40542024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40552024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40562024-09-10T21:34:05.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40572024-09-10T21:34:05.780ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-403254df-bc94-46d0-9b33-45b17d93603a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2997, tv_nsec: 297266714 } })
40582024-09-10T21:34:05.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
40592024-09-10T21:34:05.780ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40602024-09-10T21:34:05.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40612024-09-10T21:34:05.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40622024-09-10T21:34:05.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.682161ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40632024-09-10T21:34:05.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40642024-09-10T21:34:05.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d88bd77-1eca-41ed-93c4-7678f6a0586f, lookup_type: ById(0d88bd77-1eca-41ed-93c4-7678f6a0586f) } result = Ok(())
40652024-09-10T21:34:05.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40662024-09-10T21:34:05.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40672024-09-10T21:34:05.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40682024-09-10T21:34:05.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40692024-09-10T21:34:05.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40702024-09-10T21:34:05.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f original_time_created = 2024-09-10 21:24:22.744364 UTC target_id = 0d88bd77-1eca-41ed-93c4-7678f6a0586f time_created = 2024-09-10 21:24:22.744364 UTC
40712024-09-10T21:34:05.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.283026ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d88bd77-1eca-41ed-93c4-7678f6a0586f","time_created":"2024-09-10T21:24:22.744364Z"}
40722024-09-10T21:34:05.803ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
40732024-09-10T21:34:05.803ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40742024-09-10T21:34:05.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40752024-09-10T21:34:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40762024-09-10T21:34:05.806ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
40772024-09-10T21:34:05.806ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40782024-09-10T21:34:05.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40792024-09-10T21:34:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40802024-09-10T21:34:05.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.849327ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
40812024-09-10T21:34:05.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40822024-09-10T21:34:05.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40832024-09-10T21:34:05.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.196329ms iteration = 20 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
40842024-09-10T21:34:05.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40852024-09-10T21:34:05.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40862024-09-10T21:34:05.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40872024-09-10T21:34:05.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40882024-09-10T21:34:05.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40892024-09-10T21:34:05.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 54.631783ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40902024-09-10T21:34:05.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912024-09-10T21:34:05.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.498636ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40922024-09-10T21:34:05.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 403254df-bc94-46d0-9b33-45b17d93603a, lookup_type: ById(403254df-bc94-46d0-9b33-45b17d93603a) } result = Ok(())
40932024-09-10T21:34:05.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40942024-09-10T21:34:05.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40952024-09-10T21:34:05.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40962024-09-10T21:34:05.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40972024-09-10T21:34:05.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40982024-09-10T21:34:05.825ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40992024-09-10T21:34:05.825ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.1606ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41002024-09-10T21:34:05.825ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.406551ms iteration = 20 status = 0
41012024-09-10T21:34:05.844ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
41022024-09-10T21:34:05.844ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41032024-09-10T21:34:05.844ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.464796ms iteration = 20 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
41042024-09-10T21:34:05.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f90f989b-be88-4ef0-8d4f-9f59049b6c3d roles = RoleSet { roles: {} } uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
41052024-09-10T21:34:05.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f90f989b-be88-4ef0-8d4f-9f59049b6c3d resource = Database result = Ok(()) uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
41062024-09-10T21:34:05.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45782 req_id = f90f989b-be88-4ef0-8d4f-9f59049b6c3d response_code = 200 uri = /probes/403254df-bc94-46d0-9b33-45b17d93603a
41072024-09-10T21:34:05.863ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41082024-09-10T21:34:05.863ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41092024-09-10T21:34:05.863ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8128166c-da0f-4f9a-b2b3-fb9ef6d2d38c", "content-length": "26", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41102024-09-10T21:34:05.863ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41112024-09-10T21:34:05.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41122024-09-10T21:34:05.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41132024-09-10T21:34:05.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41142024-09-10T21:34:05.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41152024-09-10T21:34:05.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41162024-09-10T21:34:05.879ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.022187ms iteration = 23 status = {"physical_disks_added":0}
41172024-09-10T21:34:05.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 zone_address = fd00:1122:3344:101::2
41182024-09-10T21:34:05.886ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41192024-09-10T21:34:05.887ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fc1087c2-a73d-4fbd-ac16-e581f60543aa", "content-length": "26", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41202024-09-10T21:34:05.887ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41212024-09-10T21:34:05.889ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41222024-09-10T21:34:05.889ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41232024-09-10T21:34:05.889ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45e8c384-98a4-4776-8118-0590613b6f34", "content-length": "26", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41242024-09-10T21:34:05.889ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41252024-09-10T21:34:05.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
41262024-09-10T21:34:05.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41272024-09-10T21:34:05.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41282024-09-10T21:34:05.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9150cd27-8e70-4e7e-a5b9-51a2562092b8", "content-length": "372", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41292024-09-10T21:34:05.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41302024-09-10T21:34:05.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41312024-09-10T21:34:05.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41322024-09-10T21:34:05.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41332024-09-10T21:34:05.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41342024-09-10T21:34:05.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41352024-09-10T21:34:05.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41362024-09-10T21:34:05.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41372024-09-10T21:34:05.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41382024-09-10T21:34:05.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41392024-09-10T21:34:05.978ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41402024-09-10T21:34:05.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41412024-09-10T21:34:05.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41422024-09-10T21:34:05.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41432024-09-10T21:34:05.981ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.170179ms iteration = 20 status = {}
41442024-09-10T21:34:05.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41452024-09-10T21:34:05.981ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "72f8830f-7d57-4b71-a8f8-2e83d92bd5c3", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41462024-09-10T21:34:05.982ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 217.780619ms iteration = 22 status = {}
41472024-09-10T21:34:06.016ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41482024-09-10T21:34:06.016ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9cf43f84-41b1-49a0-92eb-932ad7548921", "content-length": "2", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41492024-09-10T21:34:06.019ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41502024-09-10T21:34:06.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41512024-09-10T21:34:06.022ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 258.997519ms iteration = 20 status = null
41522024-09-10T21:34:06.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41532024-09-10T21:34:06.073ZDEBGnexus (BackgroundTasks): client response SledAgent = 403254df-bc94-46d0-9b33-45b17d93603a background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c76bf0e0-688c-47c7-8467-d8cef846a3c7", "content-length": "691", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41542024-09-10T21:34:06.073ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41552024-09-10T21:34:06.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41562024-09-10T21:34:06.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41572024-09-10T21:34:06.074ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 310.608359ms iteration = 21 status = {}
41582024-09-10T21:34:06.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41592024-09-10T21:34:06.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41602024-09-10T21:34:06.110ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 5e4c25f1-decc-444d-a2e8-d35490f4193e, rack_id: ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(567e7c12-0291-49d1-8f8a-17d6578ec2f4) } rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
41612024-09-10T21:34:06.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41622024-09-10T21:34:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41632024-09-10T21:34:06.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41642024-09-10T21:34:06.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8aaf817e-9fa0-4536-8a85-65536a6961e1", "content-length": "121", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41652024-09-10T21:34:06.132ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
41662024-09-10T21:34:06.132ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 567e7c12-0291-49d1-8f8a-17d6578ec2f4
41672024-09-10T21:34:06.133ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41682024-09-10T21:34:06.133ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41692024-09-10T21:34:06.133ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
41702024-09-10T21:34:06.133ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 routes = {}
41712024-09-10T21:34:06.133ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75
41722024-09-10T21:34:06.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41732024-09-10T21:34:06.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41742024-09-10T21:34:06.135ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41752024-09-10T21:34:06.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "52942d6c-6022-429f-9e99-638a5ec05137", "content-length": "2", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41762024-09-10T21:34:06.135ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41772024-09-10T21:34:06.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63380a56-7264-4f68-bd65-028bba9ab803", "content-length": "52", "date": "Tue, 10 Sep 2024 21:34:05 GMT"} })
41782024-09-10T21:34:06.135ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 switch_location = Switch0
41792024-09-10T21:34:06.135ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ebaa0c37-a4ae-43ac-95a9-ac9cdaefcd75 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports