Max level shown:
12024-12-19T06:00:02.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 44702f1b-8f15-47af-8cf5-bd0099fd098d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
22024-12-19T06:00:02.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 44702f1b-8f15-47af-8cf5-bd0099fd098d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
32024-12-19T06:00:02.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 44702f1b-8f15-47af-8cf5-bd0099fd098d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42024-12-19T06:00:03.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1de5c89f-0186-42b0-bb11-9f336ca78740 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
52024-12-19T06:00:03.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1de5c89f-0186-42b0-bb11-9f336ca78740 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62024-12-19T06:00:03.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1de5c89f-0186-42b0-bb11-9f336ca78740 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
72024-12-19T06:00:04.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 84b1175b-61d9-4dcb-9410-7238fdda7bca roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
82024-12-19T06:00:04.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 84b1175b-61d9-4dcb-9410-7238fdda7bca resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
92024-12-19T06:00:04.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 84b1175b-61d9-4dcb-9410-7238fdda7bca response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
102024-12-19T06:00:04.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 590d427a-c3c9-47f3-bfe8-7f04d6500c9e response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
112024-12-19T06:00:05.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d8aea6e0-1b8c-428f-beba-739b20c90cfb roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
122024-12-19T06:00:05.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d8aea6e0-1b8c-428f-beba-739b20c90cfb resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
132024-12-19T06:00:05.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d8aea6e0-1b8c-428f-beba-739b20c90cfb response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
142024-12-19T06:00:06.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 464e6813-f2ca-4848-a72a-df0be4dd70ee roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
152024-12-19T06:00:06.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 464e6813-f2ca-4848-a72a-df0be4dd70ee resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
162024-12-19T06:00:06.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 464e6813-f2ca-4848-a72a-df0be4dd70ee response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
172024-12-19T06:00:07.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4c9857c7-dd80-4d6d-ac8a-e2b97cc5c70b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
182024-12-19T06:00:07.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4c9857c7-dd80-4d6d-ac8a-e2b97cc5c70b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
192024-12-19T06:00:07.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4c9857c7-dd80-4d6d-ac8a-e2b97cc5c70b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
202024-12-19T06:00:08.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9b1018ce-58ba-4514-900e-707f9c9d4329 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
212024-12-19T06:00:08.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9b1018ce-58ba-4514-900e-707f9c9d4329 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
222024-12-19T06:00:08.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9b1018ce-58ba-4514-900e-707f9c9d4329 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
232024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
242024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
252024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
262024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
272024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
282024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
292024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
302024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
312024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
322024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
332024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
342024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
362024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
372024-12-19T06:00:08.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
382024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
392024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
402024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
412024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
422024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
432024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
442024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
452024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
462024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
472024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
482024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
492024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
502024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
512024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
522024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
532024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
542024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
552024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
562024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
572024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
582024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
592024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
602024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
612024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
622024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
632024-12-19T06:00:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
642024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
652024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
662024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
672024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
682024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
692024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
702024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
712024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
722024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
732024-12-19T06:00:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
742024-12-19T06:00:08.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
752024-12-19T06:00:08.765ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1411, tv_nsec: 480354555 } })
762024-12-19T06:00:08.766ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
772024-12-19T06:00:08.766ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.821013ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
782024-12-19T06:00:08.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
792024-12-19T06:00:08.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
802024-12-19T06:00:08.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
812024-12-19T06:00:08.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
822024-12-19T06:00:08.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
832024-12-19T06:00:08.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
842024-12-19T06:00:08.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
852024-12-19T06:00:08.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1411, tv_nsec: 489002524 } })
862024-12-19T06:00:08.774ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
872024-12-19T06:00:08.776ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1411, tv_nsec: 490798032 } })
882024-12-19T06:00:08.776ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
892024-12-19T06:00:08.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
902024-12-19T06:00:08.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
912024-12-19T06:00:08.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
922024-12-19T06:00:08.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
932024-12-19T06:00:08.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
942024-12-19T06:00:08.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
952024-12-19T06:00:08.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
962024-12-19T06:00:08.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
972024-12-19T06:00:08.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
982024-12-19T06:00:08.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
992024-12-19T06:00:08.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1002024-12-19T06:00:08.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1012024-12-19T06:00:08.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1022024-12-19T06:00:08.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1032024-12-19T06:00:08.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1042024-12-19T06:00:08.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1052024-12-19T06:00:08.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1062024-12-19T06:00:08.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1072024-12-19T06:00:08.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1082024-12-19T06:00:08.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1092024-12-19T06:00:08.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1102024-12-19T06:00:08.810ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1112024-12-19T06:00:08.810ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1122024-12-19T06:00:08.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1132024-12-19T06:00:08.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1142024-12-19T06:00:08.811ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1152024-12-19T06:00:08.811ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1162024-12-19T06:00:08.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1172024-12-19T06:00:08.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.815182ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
1182024-12-19T06:00:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1192024-12-19T06:00:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1202024-12-19T06:00:08.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1212024-12-19T06:00:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1222024-12-19T06:00:08.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1232024-12-19T06:00:08.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.107626ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1242024-12-19T06:00:08.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1252024-12-19T06:00:08.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1262024-12-19T06:00:08.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1272024-12-19T06:00:08.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1282024-12-19T06:00:08.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1292024-12-19T06:00:08.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1302024-12-19T06:00:08.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1312024-12-19T06:00:08.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.233569ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
1322024-12-19T06:00:08.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1332024-12-19T06:00:08.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1342024-12-19T06:00:08.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1352024-12-19T06:00:08.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1362024-12-19T06:00:08.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1372024-12-19T06:00:08.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1382024-12-19T06:00:08.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
1392024-12-19T06:00:08.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1402024-12-19T06:00:08.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1412024-12-19T06:00:08.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
1422024-12-19T06:00:08.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1432024-12-19T06:00:08.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1442024-12-19T06:00:08.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.701006ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1452024-12-19T06:00:08.854ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.93755ms iteration = 14 status = 0
1462024-12-19T06:00:08.855ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1472024-12-19T06:00:08.855ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1482024-12-19T06:00:08.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1492024-12-19T06:00:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1502024-12-19T06:00:08.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1512024-12-19T06:00:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1522024-12-19T06:00:08.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1532024-12-19T06:00:08.858ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1542024-12-19T06:00:08.858ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1552024-12-19T06:00:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1562024-12-19T06:00:08.858ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4789d350-8131-497b-8441-1b84046b8769", "content-length": "26", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
1572024-12-19T06:00:08.858ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1582024-12-19T06:00:08.861ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1592024-12-19T06:00:08.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.359594ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
1602024-12-19T06:00:08.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
1612024-12-19T06:00:08.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.575601ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
1622024-12-19T06:00:08.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.740726ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1632024-12-19T06:00:08.868ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
1642024-12-19T06:00:08.868ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1652024-12-19T06:00:08.868ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1662024-12-19T06:00:08.868ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1672024-12-19T06:00:08.868ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1682024-12-19T06:00:08.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.897021ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1692024-12-19T06:00:08.868ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b569e1a-a442-4619-884e-f282954714db", "content-length": "26", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
1702024-12-19T06:00:08.868ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1712024-12-19T06:00:08.868ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e64f230-cb0c-4f88-b205-2656d4234e19", "content-length": "26", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
1722024-12-19T06:00:08.868ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1732024-12-19T06:00:08.870ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
1742024-12-19T06:00:08.870ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1752024-12-19T06:00:08.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1762024-12-19T06:00:08.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1772024-12-19T06:00:08.884ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1782024-12-19T06:00:08.884ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1792024-12-19T06:00:08.884ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.32044ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1802024-12-19T06:00:08.950ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.554545ms iteration = 14 status = {}
1812024-12-19T06:00:08.957ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.714263ms iteration = 16 status = {"physical_disks_added":0}
1822024-12-19T06:00:08.960ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1832024-12-19T06:00:08.960ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "71d7cb3c-6369-4895-b524-c5bb8f121272", "content-length": "1", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
1842024-12-19T06:00:08.961ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1852024-12-19T06:00:08.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1862024-12-19T06:00:08.963ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 201.334817ms iteration = 14 status = null
1872024-12-19T06:00:08.966ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1882024-12-19T06:00:08.966ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1892024-12-19T06:00:08.967ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cc20f5a-bbcd-44ef-b270-ae2cdf998881", "content-length": "372", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
1902024-12-19T06:00:08.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1912024-12-19T06:00:08.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1922024-12-19T06:00:08.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1932024-12-19T06:00:08.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1942024-12-19T06:00:08.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1952024-12-19T06:00:08.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1962024-12-19T06:00:08.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1972024-12-19T06:00:08.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1982024-12-19T06:00:09.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1992024-12-19T06:00:09.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2002024-12-19T06:00:09.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2012024-12-19T06:00:09.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2022024-12-19T06:00:09.020ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2032024-12-19T06:00:09.020ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2042024-12-19T06:00:09.020ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "da2a20e2-5f55-46e8-8773-3871e3840e40", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
2052024-12-19T06:00:09.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2062024-12-19T06:00:09.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2072024-12-19T06:00:09.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2082024-12-19T06:00:09.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2092024-12-19T06:00:09.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2102024-12-19T06:00:09.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2112024-12-19T06:00:09.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2122024-12-19T06:00:09.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2132024-12-19T06:00:09.029ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2142024-12-19T06:00:09.029ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2152024-12-19T06:00:09.030ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
2162024-12-19T06:00:09.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2172024-12-19T06:00:09.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2182024-12-19T06:00:09.030ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7fcf3121-6501-40c6-854b-88ccdc0c131b", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
2192024-12-19T06:00:09.032ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 270.111232ms iteration = 14 status = {}
2202024-12-19T06:00:09.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2212024-12-19T06:00:09.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a68d3040-c4fd-4974-8705-a0cde6c33864", "content-length": "134", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
2222024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2232024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
2242024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2252024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2262024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2272024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2282024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2292024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2302024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2312024-12-19T06:00:09.040ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2322024-12-19T06:00:09.041ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
2332024-12-19T06:00:09.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2342024-12-19T06:00:09.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2352024-12-19T06:00:09.043ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2362024-12-19T06:00:09.043ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0712d888-8958-441f-af3e-7b1e8f5806cf", "content-length": "2", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
2372024-12-19T06:00:09.043ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2382024-12-19T06:00:09.043ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf3102f7-e600-4b5f-bada-c767862b5af5", "content-length": "52", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
2392024-12-19T06:00:09.043ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
2402024-12-19T06:00:09.043ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2412024-12-19T06:00:09.093ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2422024-12-19T06:00:09.150ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5ea8a2bd-2f2c-442a-9733-8198e70b3ef9", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
2432024-12-19T06:00:09.150ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
2442024-12-19T06:00:09.150ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2452024-12-19T06:00:09.151ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "975b864d-f998-418f-a12b-103ffcf7448a", "content-length": "691", "date": "Thu, 19 Dec 2024 06:00:08 GMT"} })
2462024-12-19T06:00:09.151ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2472024-12-19T06:00:09.151ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2482024-12-19T06:00:09.151ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2492024-12-19T06:00:09.151ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c324827-6077-4a0c-925f-20b3b9f5e15c", "content-length": "682", "date": "Thu, 19 Dec 2024 06:00:09 GMT"} })
2502024-12-19T06:00:09.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2512024-12-19T06:00:09.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2522024-12-19T06:00:09.152ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 390.257653ms iteration = 14 status = {}
2532024-12-19T06:00:09.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2542024-12-19T06:00:09.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2552024-12-19T06:00:09.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2562024-12-19T06:00:09.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2572024-12-19T06:00:09.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2582024-12-19T06:00:09.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2592024-12-19T06:00:09.167ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 405.457763ms iteration = 14 status = {}
2602024-12-19T06:00:09.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 48ed183b-9839-4217-b83d-8f69d3a8956d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2612024-12-19T06:00:09.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 48ed183b-9839-4217-b83d-8f69d3a8956d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2622024-12-19T06:00:09.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 48ed183b-9839-4217-b83d-8f69d3a8956d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2632024-12-19T06:00:10.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c2c1cfc0-db55-4851-94d6-53808a1cf26a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2642024-12-19T06:00:10.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c2c1cfc0-db55-4851-94d6-53808a1cf26a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2652024-12-19T06:00:10.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c2c1cfc0-db55-4851-94d6-53808a1cf26a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2662024-12-19T06:00:11.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0f55bf41-26a1-4c49-bc2a-a501e2b0d4ca roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2672024-12-19T06:00:11.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0f55bf41-26a1-4c49-bc2a-a501e2b0d4ca resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2682024-12-19T06:00:11.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0f55bf41-26a1-4c49-bc2a-a501e2b0d4ca response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2692024-12-19T06:00:12.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 574975d8-85be-42ca-9695-394d90efe08b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2702024-12-19T06:00:12.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 574975d8-85be-42ca-9695-394d90efe08b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2712024-12-19T06:00:12.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 574975d8-85be-42ca-9695-394d90efe08b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2722024-12-19T06:00:13.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9562bb33-6e4a-43de-8ff6-51f22b4087c6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2732024-12-19T06:00:13.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9562bb33-6e4a-43de-8ff6-51f22b4087c6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2742024-12-19T06:00:13.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9562bb33-6e4a-43de-8ff6-51f22b4087c6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2752024-12-19T06:00:14.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab85d9d5-db28-4e7c-a6ec-dddd5d92dba9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2762024-12-19T06:00:14.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab85d9d5-db28-4e7c-a6ec-dddd5d92dba9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2772024-12-19T06:00:14.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab85d9d5-db28-4e7c-a6ec-dddd5d92dba9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2782024-12-19T06:00:14.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 453 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 5d65b5cc-1fc8-4db7-8c01-80b70d2eb5af response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
2792024-12-19T06:00:15.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0181aa8d-c2ee-4b8a-a755-667d68a88e21 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2802024-12-19T06:00:15.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0181aa8d-c2ee-4b8a-a755-667d68a88e21 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2812024-12-19T06:00:15.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0181aa8d-c2ee-4b8a-a755-667d68a88e21 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2822024-12-19T06:00:16.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 352ee6cf-4e09-42c0-a318-ffced1eeae32 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2832024-12-19T06:00:16.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 352ee6cf-4e09-42c0-a318-ffced1eeae32 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2842024-12-19T06:00:16.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 352ee6cf-4e09-42c0-a318-ffced1eeae32 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2852024-12-19T06:00:17.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85eea3a5-838d-4214-92d2-757dece0a2fd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2862024-12-19T06:00:17.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85eea3a5-838d-4214-92d2-757dece0a2fd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2872024-12-19T06:00:17.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85eea3a5-838d-4214-92d2-757dece0a2fd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
2882024-12-19T06:00:18.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
2892024-12-19T06:00:18.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
2902024-12-19T06:00:18.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2912024-12-19T06:00:18.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2922024-12-19T06:00:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2932024-12-19T06:00:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2942024-12-19T06:00:18.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952024-12-19T06:00:18.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2962024-12-19T06:00:18.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2972024-12-19T06:00:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2982024-12-19T06:00:18.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2992024-12-19T06:00:18.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3002024-12-19T06:00:18.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3012024-12-19T06:00:18.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
3022024-12-19T06:00:18.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3032024-12-19T06:00:18.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3042024-12-19T06:00:18.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
3052024-12-19T06:00:18.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.717018ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
3062024-12-19T06:00:18.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3072024-12-19T06:00:18.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3082024-12-19T06:00:18.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.126158ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3092024-12-19T06:00:18.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bb484ba9-c5a2-4945-afe5-e37105e8470c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3102024-12-19T06:00:18.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bb484ba9-c5a2-4945-afe5-e37105e8470c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3112024-12-19T06:00:18.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bb484ba9-c5a2-4945-afe5-e37105e8470c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3122024-12-19T06:00:19.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 59d85a0d-be5b-4a40-9696-9d3d333300e7 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3132024-12-19T06:00:19.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 59d85a0d-be5b-4a40-9696-9d3d333300e7 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3142024-12-19T06:00:19.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 59d85a0d-be5b-4a40-9696-9d3d333300e7 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3152024-12-19T06:00:20.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d862f5d4-b87c-4d01-a91a-35de8fba88d3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3162024-12-19T06:00:20.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d862f5d4-b87c-4d01-a91a-35de8fba88d3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3172024-12-19T06:00:20.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d862f5d4-b87c-4d01-a91a-35de8fba88d3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3182024-12-19T06:00:21.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = abe9fc66-ff10-4c92-80d0-ae4fa5e92d8d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3192024-12-19T06:00:21.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = abe9fc66-ff10-4c92-80d0-ae4fa5e92d8d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3202024-12-19T06:00:21.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = abe9fc66-ff10-4c92-80d0-ae4fa5e92d8d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3212024-12-19T06:00:22.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d6401fe2-d63e-4404-8ade-6372a05f416c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3222024-12-19T06:00:22.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d6401fe2-d63e-4404-8ade-6372a05f416c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3232024-12-19T06:00:22.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d6401fe2-d63e-4404-8ade-6372a05f416c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3242024-12-19T06:00:23.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 121e9d1a-6106-4db7-bd3f-5bb506c1f069 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3252024-12-19T06:00:23.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 121e9d1a-6106-4db7-bd3f-5bb506c1f069 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3262024-12-19T06:00:23.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 121e9d1a-6106-4db7-bd3f-5bb506c1f069 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3272024-12-19T06:00:24.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f2adbc0f-e7a9-498f-aed2-11156b05bc7d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3282024-12-19T06:00:24.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f2adbc0f-e7a9-498f-aed2-11156b05bc7d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3292024-12-19T06:00:24.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f2adbc0f-e7a9-498f-aed2-11156b05bc7d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3302024-12-19T06:00:25.000ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = dff4ace7-61cc-4f27-8cda-aac641283e01 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
3312024-12-19T06:00:26.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 863821ea-fcba-4150-bd04-38a529cca4c9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3322024-12-19T06:00:26.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 863821ea-fcba-4150-bd04-38a529cca4c9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3332024-12-19T06:00:26.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 863821ea-fcba-4150-bd04-38a529cca4c9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3342024-12-19T06:00:27.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39fb35fc-e6e0-4c29-8213-1c269d533a98 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3352024-12-19T06:00:27.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39fb35fc-e6e0-4c29-8213-1c269d533a98 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3362024-12-19T06:00:27.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39fb35fc-e6e0-4c29-8213-1c269d533a98 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3372024-12-19T06:00:28.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 931d37c2-d189-45ae-9993-ef4f7b336aac roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3382024-12-19T06:00:28.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 931d37c2-d189-45ae-9993-ef4f7b336aac resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3392024-12-19T06:00:28.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 931d37c2-d189-45ae-9993-ef4f7b336aac response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3402024-12-19T06:00:28.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
3412024-12-19T06:00:28.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
3422024-12-19T06:00:28.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3432024-12-19T06:00:28.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3442024-12-19T06:00:28.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3452024-12-19T06:00:28.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3462024-12-19T06:00:28.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3472024-12-19T06:00:28.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3482024-12-19T06:00:28.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3492024-12-19T06:00:28.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.623846ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3502024-12-19T06:00:28.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3512024-12-19T06:00:28.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3522024-12-19T06:00:28.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3532024-12-19T06:00:28.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3542024-12-19T06:00:28.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3552024-12-19T06:00:28.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3562024-12-19T06:00:28.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
3572024-12-19T06:00:28.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3582024-12-19T06:00:28.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3592024-12-19T06:00:28.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
3602024-12-19T06:00:28.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.311829ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
3612024-12-19T06:00:29.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ac3a2212-4a95-42e6-bfef-a44e0238f882 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3622024-12-19T06:00:29.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ac3a2212-4a95-42e6-bfef-a44e0238f882 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3632024-12-19T06:00:29.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ac3a2212-4a95-42e6-bfef-a44e0238f882 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3642024-12-19T06:00:30.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d27c02d3-2b9d-4651-856a-423b83dffb3a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3652024-12-19T06:00:30.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d27c02d3-2b9d-4651-856a-423b83dffb3a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3662024-12-19T06:00:30.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d27c02d3-2b9d-4651-856a-423b83dffb3a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3672024-12-19T06:00:31.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e0be128c-3111-4a15-978a-67b2138c69c1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3682024-12-19T06:00:31.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e0be128c-3111-4a15-978a-67b2138c69c1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3692024-12-19T06:00:31.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e0be128c-3111-4a15-978a-67b2138c69c1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3702024-12-19T06:00:32.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db14fae1-90f3-4c00-a691-a3a6712a43e0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3712024-12-19T06:00:32.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db14fae1-90f3-4c00-a691-a3a6712a43e0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3722024-12-19T06:00:32.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db14fae1-90f3-4c00-a691-a3a6712a43e0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3732024-12-19T06:00:33.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 132807f4-c1ec-4514-b6e9-12f920abc99b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3742024-12-19T06:00:33.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 132807f4-c1ec-4514-b6e9-12f920abc99b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3752024-12-19T06:00:33.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 132807f4-c1ec-4514-b6e9-12f920abc99b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3762024-12-19T06:00:34.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f0cd04e7-d165-4dbc-bd80-762a51d4a726 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3772024-12-19T06:00:34.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f0cd04e7-d165-4dbc-bd80-762a51d4a726 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3782024-12-19T06:00:34.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f0cd04e7-d165-4dbc-bd80-762a51d4a726 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3792024-12-19T06:00:34.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 426 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = e326f677-1f1c-4e63-9067-5f9d2f76a311 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
3802024-12-19T06:00:35.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 94c05e1d-7971-4bc6-8f49-9e263097264b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3812024-12-19T06:00:35.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 94c05e1d-7971-4bc6-8f49-9e263097264b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3822024-12-19T06:00:35.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 94c05e1d-7971-4bc6-8f49-9e263097264b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3832024-12-19T06:00:36.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 06b784ff-7fc6-4fa5-8a95-5004348e5c5b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3842024-12-19T06:00:36.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 06b784ff-7fc6-4fa5-8a95-5004348e5c5b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3852024-12-19T06:00:36.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 06b784ff-7fc6-4fa5-8a95-5004348e5c5b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3862024-12-19T06:00:37.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0e6e5bf5-0ca5-40b8-93ec-2b8c5104818e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3872024-12-19T06:00:37.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0e6e5bf5-0ca5-40b8-93ec-2b8c5104818e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3882024-12-19T06:00:37.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0e6e5bf5-0ca5-40b8-93ec-2b8c5104818e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3892024-12-19T06:00:38.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7dc2d28b-e8d8-4fb5-be55-a376d4c1e250 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3902024-12-19T06:00:38.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7dc2d28b-e8d8-4fb5-be55-a376d4c1e250 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3912024-12-19T06:00:38.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7dc2d28b-e8d8-4fb5-be55-a376d4c1e250 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
3922024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
3932024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
3942024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
3952024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
3962024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3972024-12-19T06:00:38.762ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 05:50:38.762661583 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3982024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3992024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
4002024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4012024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
4022024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4032024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
4042024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
4052024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4062024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
4072024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
4082024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4092024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
4102024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4112024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
4122024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4132024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4142024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
4152024-12-19T06:00:38.762ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4162024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4172024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
4182024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4192024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
4202024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4212024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
4222024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
4232024-12-19T06:00:38.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4242024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4252024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
4262024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4272024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4282024-12-19T06:00:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
4292024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4302024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
4312024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4322024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
4332024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
4342024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4352024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4362024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4372024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
4382024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
4392024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4402024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4412024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
4422024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
4432024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
4442024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
4452024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4462024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4472024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4482024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
4492024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
4502024-12-19T06:00:38.763ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ec4c486a-8de5-4892-b4b1-13175064de2e
4512024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4522024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.771\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e"}
4532024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
4542024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4552024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4562024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4572024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4582024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4592024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4602024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4612024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4622024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4632024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4642024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4652024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4662024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4672024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4682024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4692024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4702024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4712024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4722024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4732024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4742024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4752024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4762024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4772024-12-19T06:00:38.763ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ecedc0eb-6c7d-4958-9fee-747c67187e55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1441, tv_nsec: 478514886 } })
4782024-12-19T06:00:38.763ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("75a56219-191b-4e5c-8eb1-d0e62e0c42f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1441, tv_nsec: 478532366 } })
4792024-12-19T06:00:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4802024-12-19T06:00:38.764ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
4812024-12-19T06:00:38.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.319543ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4822024-12-19T06:00:38.764ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
4832024-12-19T06:00:38.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.613892ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
4842024-12-19T06:00:38.766ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.490472ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
4852024-12-19T06:00:38.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4862024-12-19T06:00:38.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4872024-12-19T06:00:38.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4882024-12-19T06:00:38.767ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.717042ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4892024-12-19T06:00:38.767ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 05:50:38.762661583 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4902024-12-19T06:00:38.768ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.332672ms iteration = 8 status = {"expiration":"2024-12-19T05:50:38.762661583Z","pruned":[]}
4912024-12-19T06:00:38.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4922024-12-19T06:00:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4932024-12-19T06:00:38.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4942024-12-19T06:00:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4952024-12-19T06:00:38.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4962024-12-19T06:00:38.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4972024-12-19T06:00:38.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4982024-12-19T06:00:38.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4992024-12-19T06:00:38.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5002024-12-19T06:00:38.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5012024-12-19T06:00:38.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5022024-12-19T06:00:38.771ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5032024-12-19T06:00:38.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5042024-12-19T06:00:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5052024-12-19T06:00:38.774ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5062024-12-19T06:00:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5072024-12-19T06:00:38.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-12-19T06:00:38.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5092024-12-19T06:00:38.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5102024-12-19T06:00:38.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5112024-12-19T06:00:38.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5122024-12-19T06:00:38.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5132024-12-19T06:00:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5142024-12-19T06:00:38.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-12-19T06:00:38.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5162024-12-19T06:00:38.780ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5172024-12-19T06:00:38.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5182024-12-19T06:00:38.782ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1441, tv_nsec: 497642702 } })
5192024-12-19T06:00:38.783ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1441, tv_nsec: 497799437 } })
5202024-12-19T06:00:38.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5212024-12-19T06:00:38.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5222024-12-19T06:00:38.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5232024-12-19T06:00:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5242024-12-19T06:00:38.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5252024-12-19T06:00:38.783ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5262024-12-19T06:00:38.783ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5272024-12-19T06:00:38.783ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5282024-12-19T06:00:38.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292024-12-19T06:00:38.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5302024-12-19T06:00:38.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5312024-12-19T06:00:38.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5322024-12-19T06:00:38.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5332024-12-19T06:00:38.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5342024-12-19T06:00:38.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5352024-12-19T06:00:38.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5362024-12-19T06:00:38.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372024-12-19T06:00:38.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5382024-12-19T06:00:38.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5392024-12-19T06:00:38.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5402024-12-19T06:00:38.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5412024-12-19T06:00:38.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5422024-12-19T06:00:38.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
5432024-12-19T06:00:38.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5442024-12-19T06:00:38.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5452024-12-19T06:00:38.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5462024-12-19T06:00:38.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5472024-12-19T06:00:38.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5482024-12-19T06:00:38.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.646922ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
5492024-12-19T06:00:38.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.718868ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5502024-12-19T06:00:38.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.964899ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
5512024-12-19T06:00:38.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522024-12-19T06:00:38.827ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5532024-12-19T06:00:38.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5542024-12-19T06:00:38.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5552024-12-19T06:00:38.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5562024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5572024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5582024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.481442ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5602024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5612024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5622024-12-19T06:00:38.829ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5632024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.613706ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5642024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
5652024-12-19T06:00:38.829ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.068881ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
5662024-12-19T06:00:38.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5672024-12-19T06:00:38.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5682024-12-19T06:00:38.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5692024-12-19T06:00:38.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5702024-12-19T06:00:38.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5712024-12-19T06:00:38.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5722024-12-19T06:00:38.835ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5732024-12-19T06:00:38.835ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5742024-12-19T06:00:38.835ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.477774ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5752024-12-19T06:00:38.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5762024-12-19T06:00:38.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1441, tv_nsec: 550491365 } })
5772024-12-19T06:00:38.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
5782024-12-19T06:00:38.836ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
5792024-12-19T06:00:38.836ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
5802024-12-19T06:00:38.836ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
5812024-12-19T06:00:38.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5822024-12-19T06:00:38.836ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5832024-12-19T06:00:38.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5842024-12-19T06:00:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5852024-12-19T06:00:38.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5862024-12-19T06:00:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5872024-12-19T06:00:38.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5882024-12-19T06:00:38.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5892024-12-19T06:00:38.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5902024-12-19T06:00:38.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5912024-12-19T06:00:38.843ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
5922024-12-19T06:00:38.843ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
5932024-12-19T06:00:38.843ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
5942024-12-19T06:00:38.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5952024-12-19T06:00:38.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5962024-12-19T06:00:38.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-12-19T06:00:38.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-12-19T06:00:38.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5992024-12-19T06:00:38.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6002024-12-19T06:00:38.846ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6012024-12-19T06:00:38.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.669095ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6022024-12-19T06:00:38.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
6032024-12-19T06:00:38.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6042024-12-19T06:00:38.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6052024-12-19T06:00:38.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6062024-12-19T06:00:38.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6072024-12-19T06:00:38.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6082024-12-19T06:00:38.849ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.638391ms iteration = 15 status = 0
6092024-12-19T06:00:38.850ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6102024-12-19T06:00:38.850ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6112024-12-19T06:00:38.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6122024-12-19T06:00:38.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6132024-12-19T06:00:38.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-12-19T06:00:38.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6152024-12-19T06:00:38.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6162024-12-19T06:00:38.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6172024-12-19T06:00:38.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6182024-12-19T06:00:38.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6192024-12-19T06:00:38.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.442891ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6202024-12-19T06:00:38.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.865936ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6212024-12-19T06:00:38.875ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6222024-12-19T06:00:38.875ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 0 version = 2
6232024-12-19T06:00:38.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6242024-12-19T06:00:38.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6252024-12-19T06:00:38.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6262024-12-19T06:00:38.881ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6272024-12-19T06:00:38.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6282024-12-19T06:00:38.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6292024-12-19T06:00:38.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6302024-12-19T06:00:38.884ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 1 version = 2
6312024-12-19T06:00:38.884ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
6322024-12-19T06:00:38.884ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 05:54:07.672295 UTC dns_group = external generation = 2
6332024-12-19T06:00:38.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 121.68731ms iteration = 8 status = {"generation":2}
6342024-12-19T06:00:38.886ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6352024-12-19T06:00:38.886ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6362024-12-19T06:00:38.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6372024-12-19T06:00:38.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6382024-12-19T06:00:38.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6392024-12-19T06:00:38.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6402024-12-19T06:00:38.887ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6412024-12-19T06:00:38.888ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6422024-12-19T06:00:38.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.133371ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6432024-12-19T06:00:38.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442024-12-19T06:00:38.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6452024-12-19T06:00:38.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6462024-12-19T06:00:38.891ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6472024-12-19T06:00:38.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6482024-12-19T06:00:38.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6492024-12-19T06:00:38.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6502024-12-19T06:00:38.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6512024-12-19T06:00:38.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6522024-12-19T06:00:38.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6532024-12-19T06:00:38.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6542024-12-19T06:00:38.931ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T05:53:28.550897Z, time_modified: 2024-12-19T05:53:28.550897Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }) }
6552024-12-19T06:00:38.931ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 168.111216ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]}},"default_endpoint":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
6562024-12-19T06:00:38.937ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.556794ms iteration = 17 status = {"physical_disks_added":0}
6572024-12-19T06:00:38.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6582024-12-19T06:00:38.942ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6592024-12-19T06:00:38.943ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41df3006-5171-44e7-828e-217b2f54006c", "content-length": "26", "date": "Thu, 19 Dec 2024 06:00:38 GMT"} })
6602024-12-19T06:00:38.943ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6612024-12-19T06:00:38.946ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6622024-12-19T06:00:38.946ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6632024-12-19T06:00:38.946ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 183.775591ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6642024-12-19T06:00:38.953ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6652024-12-19T06:00:38.953ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6662024-12-19T06:00:38.953ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee8c7157-eac9-44df-967d-be41ad98e935", "content-length": "26", "date": "Thu, 19 Dec 2024 06:00:38 GMT"} })
6672024-12-19T06:00:38.953ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6682024-12-19T06:00:38.956ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6692024-12-19T06:00:38.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6702024-12-19T06:00:38.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6712024-12-19T06:00:39.066ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6722024-12-19T06:00:39.066ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "88896b87-aa20-4be9-a6a6-85b7fedcba7b", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6732024-12-19T06:00:39.066ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6742024-12-19T06:00:39.068ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3c90aa1b-0d08-4ba8-9cfa-72bf07fc98a7", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6752024-12-19T06:00:39.068ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6762024-12-19T06:00:39.070ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6772024-12-19T06:00:39.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.305391ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
6782024-12-19T06:00:39.085ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6792024-12-19T06:00:39.085ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6802024-12-19T06:00:39.085ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9352629-f092-463e-8320-4d1f7814526f", "content-length": "372", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} })
6812024-12-19T06:00:39.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6822024-12-19T06:00:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6832024-12-19T06:00:39.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842024-12-19T06:00:39.087ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
6852024-12-19T06:00:39.087ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
6862024-12-19T06:00:39.087ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 05:54:06.714960 UTC dns_group = internal generation = 1
6872024-12-19T06:00:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 325.155345ms iteration = 8 status = {"generation":1}
6882024-12-19T06:00:39.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6892024-12-19T06:00:39.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6902024-12-19T06:00:39.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6912024-12-19T06:00:39.106ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6922024-12-19T06:00:39.106ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "36d89d88-6241-4970-acaa-f9f5a09c34d5", "content-length": "1", "date": "Thu, 19 Dec 2024 06:00:38 GMT"} })
6932024-12-19T06:00:39.108ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6942024-12-19T06:00:39.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6952024-12-19T06:00:39.110ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 347.148153ms iteration = 15 status = null
6962024-12-19T06:00:39.121ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 358.223361ms iteration = 15 status = {}
6972024-12-19T06:00:39.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6982024-12-19T06:00:39.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6992024-12-19T06:00:39.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7002024-12-19T06:00:39.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7012024-12-19T06:00:39.128ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
7022024-12-19T06:00:39.128ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7032024-12-19T06:00:39.128ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8551af6d-8a68-4c7b-b22c-1149848eae7f", "content-length": "26", "date": "Thu, 19 Dec 2024 06:00:38 GMT"} })
7042024-12-19T06:00:39.128ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7052024-12-19T06:00:39.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
7062024-12-19T06:00:39.133ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7072024-12-19T06:00:39.134ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7082024-12-19T06:00:39.134ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7092024-12-19T06:00:39.134ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "70002a1f-fb75-4b0d-af35-a88c95797af5", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} })
7102024-12-19T06:00:39.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7112024-12-19T06:00:39.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7122024-12-19T06:00:39.198ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7132024-12-19T06:00:39.198ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9efad4a9-35a3-4f18-a16e-e4e81add985d", "content-length": "691", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} })
7142024-12-19T06:00:39.198ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7152024-12-19T06:00:39.198ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7162024-12-19T06:00:39.198ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7172024-12-19T06:00:39.199ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 436.846423ms iteration = 15 status = {}
7182024-12-19T06:00:39.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7192024-12-19T06:00:39.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7202024-12-19T06:00:39.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7212024-12-19T06:00:39.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7222024-12-19T06:00:39.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7232024-12-19T06:00:39.204ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3b5ef0a5-f575-423b-bc36-29bb2af6130a", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7242024-12-19T06:00:39.204ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7252024-12-19T06:00:39.205ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "778177f9-20a8-439c-bc6a-ef0669f3a1ee", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7262024-12-19T06:00:39.205ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7272024-12-19T06:00:39.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "04d2cac8-efb9-4836-844b-19b46fb6dfdc", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7282024-12-19T06:00:39.207ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7292024-12-19T06:00:39.207ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7302024-12-19T06:00:39.207ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7312024-12-19T06:00:39.208ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bcaa10d0-f3d2-4352-8271-846ce82c3d75", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} })
7322024-12-19T06:00:39.210ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7332024-12-19T06:00:39.210ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.362482ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7342024-12-19T06:00:39.210ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 447.230698ms iteration = 15 status = {}
7352024-12-19T06:00:39.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7362024-12-19T06:00:39.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7372024-12-19T06:00:39.264ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
7382024-12-19T06:00:39.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7392024-12-19T06:00:39.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7402024-12-19T06:00:39.274ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7412024-12-19T06:00:39.274ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "988901f3-02ec-4946-99c4-2edd3b842a3b", "content-length": "134", "date": "Thu, 19 Dec 2024 06:00:38 GMT"} })
7422024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7432024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
7442024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7452024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7462024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7472024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7482024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7492024-12-19T06:00:39.274ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7502024-12-19T06:00:39.275ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7512024-12-19T06:00:39.275ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7522024-12-19T06:00:39.275ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
7532024-12-19T06:00:39.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7542024-12-19T06:00:39.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7552024-12-19T06:00:39.277ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7562024-12-19T06:00:39.277ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "508fe2e7-75d8-46fb-80fd-358df7507dd1", "content-length": "2", "date": "Thu, 19 Dec 2024 06:00:38 GMT"} })
7572024-12-19T06:00:39.277ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7582024-12-19T06:00:39.277ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfac5ac0-ea2a-4b9b-82a7-279c309d3dff", "content-length": "52", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} })
7592024-12-19T06:00:39.277ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
7602024-12-19T06:00:39.277ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7612024-12-19T06:00:39.376ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3dba8a81-ec5d-43c2-9ab6-d3f43e0c0741", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} })
7622024-12-19T06:00:39.376ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
7632024-12-19T06:00:39.376ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7642024-12-19T06:00:39.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d460370c-314a-4b8b-b909-ccbb019d420b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7652024-12-19T06:00:39.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d460370c-314a-4b8b-b909-ccbb019d420b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7662024-12-19T06:00:39.377ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbb951c5-b0ae-4595-aa61-6ea42b761006", "content-length": "682", "date": "Thu, 19 Dec 2024 06:00:39 GMT"} })
7672024-12-19T06:00:39.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7682024-12-19T06:00:39.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7692024-12-19T06:00:39.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d460370c-314a-4b8b-b909-ccbb019d420b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7702024-12-19T06:00:39.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7712024-12-19T06:00:39.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7722024-12-19T06:00:39.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7732024-12-19T06:00:39.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7742024-12-19T06:00:39.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7752024-12-19T06:00:39.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7762024-12-19T06:00:39.393ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 630.585805ms iteration = 15 status = {}
7772024-12-19T06:00:40.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 755232c4-cde6-4708-92d6-ef6171ef15c7 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7782024-12-19T06:00:40.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 755232c4-cde6-4708-92d6-ef6171ef15c7 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7792024-12-19T06:00:40.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 755232c4-cde6-4708-92d6-ef6171ef15c7 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7802024-12-19T06:00:41.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e3fdd9e-bcd3-4ad0-bd28-ce37bb8fe9dd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7812024-12-19T06:00:41.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e3fdd9e-bcd3-4ad0-bd28-ce37bb8fe9dd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7822024-12-19T06:00:41.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e3fdd9e-bcd3-4ad0-bd28-ce37bb8fe9dd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7832024-12-19T06:00:42.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2fee9a6c-96f7-422b-b2e2-129487ce6cd2 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7842024-12-19T06:00:42.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2fee9a6c-96f7-422b-b2e2-129487ce6cd2 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7852024-12-19T06:00:42.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2fee9a6c-96f7-422b-b2e2-129487ce6cd2 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7862024-12-19T06:00:43.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3a5d6d6b-ba77-4e27-bfa9-25d6c62cb1a9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7872024-12-19T06:00:43.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3a5d6d6b-ba77-4e27-bfa9-25d6c62cb1a9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7882024-12-19T06:00:43.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3a5d6d6b-ba77-4e27-bfa9-25d6c62cb1a9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7892024-12-19T06:00:44.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90d91051-42cd-48dd-bec5-fa6cd2aab708 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7902024-12-19T06:00:44.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90d91051-42cd-48dd-bec5-fa6cd2aab708 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7912024-12-19T06:00:44.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90d91051-42cd-48dd-bec5-fa6cd2aab708 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
7922024-12-19T06:00:44.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 2cc2fdff-696b-4900-96dc-e8ec14650b9e roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
7932024-12-19T06:00:44.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 2cc2fdff-696b-4900-96dc-e8ec14650b9e resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
7942024-12-19T06:00:44.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 2cc2fdff-696b-4900-96dc-e8ec14650b9e response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
7952024-12-19T06:00:44.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 85acafd2-de0e-48a3-a641-fc112ea3c087 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
7962024-12-19T06:00:44.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 85acafd2-de0e-48a3-a641-fc112ea3c087 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
7972024-12-19T06:00:44.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 85acafd2-de0e-48a3-a641-fc112ea3c087 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
7982024-12-19T06:00:44.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 395 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 1da11cee-e4bc-48d7-8512-012767c74c54 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
7992024-12-19T06:00:45.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab022f1e-009d-4a01-b677-8772717d236f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8002024-12-19T06:00:45.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab022f1e-009d-4a01-b677-8772717d236f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8012024-12-19T06:00:45.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab022f1e-009d-4a01-b677-8772717d236f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8022024-12-19T06:00:46.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 76b57818-87eb-4267-8bad-cc501fb5bae1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8032024-12-19T06:00:46.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 76b57818-87eb-4267-8bad-cc501fb5bae1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8042024-12-19T06:00:46.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 76b57818-87eb-4267-8bad-cc501fb5bae1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8052024-12-19T06:00:47.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 066a3dfc-dade-47a2-ac8d-2db153dc869e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8062024-12-19T06:00:47.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 066a3dfc-dade-47a2-ac8d-2db153dc869e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8072024-12-19T06:00:47.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 066a3dfc-dade-47a2-ac8d-2db153dc869e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8082024-12-19T06:00:48.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 605215af-d648-4e46-8ef4-d9fd2eec7e1a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8092024-12-19T06:00:48.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 605215af-d648-4e46-8ef4-d9fd2eec7e1a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8102024-12-19T06:00:48.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 605215af-d648-4e46-8ef4-d9fd2eec7e1a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8112024-12-19T06:00:48.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
8122024-12-19T06:00:48.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
8132024-12-19T06:00:48.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8142024-12-19T06:00:48.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8152024-12-19T06:00:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8162024-12-19T06:00:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8172024-12-19T06:00:48.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8182024-12-19T06:00:48.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8192024-12-19T06:00:48.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8202024-12-19T06:00:48.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8212024-12-19T06:00:48.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8222024-12-19T06:00:48.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8232024-12-19T06:00:48.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8242024-12-19T06:00:48.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8252024-12-19T06:00:48.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.581588ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8262024-12-19T06:00:48.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8272024-12-19T06:00:48.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
8282024-12-19T06:00:48.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8292024-12-19T06:00:48.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8302024-12-19T06:00:48.808ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
8312024-12-19T06:00:48.808ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.343622ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
8322024-12-19T06:00:49.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 46777c16-6c3e-4332-af18-27e8a9e5ab5c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8332024-12-19T06:00:49.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 46777c16-6c3e-4332-af18-27e8a9e5ab5c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8342024-12-19T06:00:49.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 46777c16-6c3e-4332-af18-27e8a9e5ab5c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8352024-12-19T06:00:50.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cfb8f7ab-40c8-4a04-a924-80328db83cbc roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8362024-12-19T06:00:50.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cfb8f7ab-40c8-4a04-a924-80328db83cbc resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8372024-12-19T06:00:50.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cfb8f7ab-40c8-4a04-a924-80328db83cbc response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8382024-12-19T06:00:51.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2e82b58a-4eb0-4cdc-a3e9-5fd283ca0492 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8392024-12-19T06:00:51.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2e82b58a-4eb0-4cdc-a3e9-5fd283ca0492 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8402024-12-19T06:00:51.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2e82b58a-4eb0-4cdc-a3e9-5fd283ca0492 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8412024-12-19T06:00:52.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d7d5c08a-25e1-4cc7-aec5-746f4ca3873a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8422024-12-19T06:00:52.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d7d5c08a-25e1-4cc7-aec5-746f4ca3873a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8432024-12-19T06:00:52.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d7d5c08a-25e1-4cc7-aec5-746f4ca3873a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8442024-12-19T06:00:53.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 71b77663-7300-406b-86d3-34f08493f0f0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8452024-12-19T06:00:53.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 71b77663-7300-406b-86d3-34f08493f0f0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8462024-12-19T06:00:53.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 71b77663-7300-406b-86d3-34f08493f0f0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8472024-12-19T06:00:54.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ecda66c0-f154-42ee-aa2d-b7924d842583 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8482024-12-19T06:00:54.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ecda66c0-f154-42ee-aa2d-b7924d842583 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8492024-12-19T06:00:54.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ecda66c0-f154-42ee-aa2d-b7924d842583 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8502024-12-19T06:00:54.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 48440bc5-ebf4-4576-9dc2-384c34b70b83 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
8512024-12-19T06:00:55.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8b59ac1f-137e-4b07-b705-b27f5f66cfb4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8522024-12-19T06:00:55.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8b59ac1f-137e-4b07-b705-b27f5f66cfb4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8532024-12-19T06:00:55.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8b59ac1f-137e-4b07-b705-b27f5f66cfb4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8542024-12-19T06:00:56.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 31c3b970-a96e-4b3b-983a-512cea309255 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8552024-12-19T06:00:56.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 31c3b970-a96e-4b3b-983a-512cea309255 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8562024-12-19T06:00:56.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 31c3b970-a96e-4b3b-983a-512cea309255 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8572024-12-19T06:00:57.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 494e4e33-d469-4a5f-bbf8-9aab619cfe09 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8582024-12-19T06:00:57.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 494e4e33-d469-4a5f-bbf8-9aab619cfe09 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8592024-12-19T06:00:57.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 494e4e33-d469-4a5f-bbf8-9aab619cfe09 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8602024-12-19T06:00:58.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
8612024-12-19T06:00:58.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
8622024-12-19T06:00:58.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8632024-12-19T06:00:58.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8642024-12-19T06:00:58.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8652024-12-19T06:00:58.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8662024-12-19T06:00:58.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8672024-12-19T06:00:58.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8682024-12-19T06:00:58.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8692024-12-19T06:00:58.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.854514ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8702024-12-19T06:00:58.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8712024-12-19T06:00:58.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8722024-12-19T06:00:58.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8732024-12-19T06:00:58.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8742024-12-19T06:00:58.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8752024-12-19T06:00:58.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8762024-12-19T06:00:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
8772024-12-19T06:00:58.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8782024-12-19T06:00:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8792024-12-19T06:00:58.781ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
8802024-12-19T06:00:58.781ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.352644ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
8812024-12-19T06:00:58.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4ab13624-cd8b-4949-9b33-190c573b79cd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8822024-12-19T06:00:58.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4ab13624-cd8b-4949-9b33-190c573b79cd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8832024-12-19T06:00:58.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4ab13624-cd8b-4949-9b33-190c573b79cd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8842024-12-19T06:00:59.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f791615-7547-485e-a484-20d3f5464d9c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8852024-12-19T06:00:59.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f791615-7547-485e-a484-20d3f5464d9c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8862024-12-19T06:00:59.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f791615-7547-485e-a484-20d3f5464d9c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8872024-12-19T06:01:00.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 61fe37f6-6e27-4726-b8cc-31175651b2e7 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8882024-12-19T06:01:00.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 61fe37f6-6e27-4726-b8cc-31175651b2e7 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8892024-12-19T06:01:00.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 61fe37f6-6e27-4726-b8cc-31175651b2e7 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8902024-12-19T06:01:01.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c4f7d313-ddfd-4ee2-a42b-b2090d4a29c0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8912024-12-19T06:01:01.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c4f7d313-ddfd-4ee2-a42b-b2090d4a29c0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8922024-12-19T06:01:01.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c4f7d313-ddfd-4ee2-a42b-b2090d4a29c0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8932024-12-19T06:01:02.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 37126004-d8cc-4643-ae0e-5b9779ada093 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8942024-12-19T06:01:02.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 37126004-d8cc-4643-ae0e-5b9779ada093 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8952024-12-19T06:01:02.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 37126004-d8cc-4643-ae0e-5b9779ada093 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8962024-12-19T06:01:03.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 02932f74-c382-4a07-b362-ee78e61a690e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8972024-12-19T06:01:03.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 02932f74-c382-4a07-b362-ee78e61a690e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8982024-12-19T06:01:03.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 02932f74-c382-4a07-b362-ee78e61a690e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
8992024-12-19T06:01:04.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 11857547-3993-4e2d-92c3-3b6805fed8e3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9002024-12-19T06:01:04.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 11857547-3993-4e2d-92c3-3b6805fed8e3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9012024-12-19T06:01:04.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 11857547-3993-4e2d-92c3-3b6805fed8e3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9022024-12-19T06:01:04.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 421 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = ca743743-73d0-445e-a900-4dc9fa039d00 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
9032024-12-19T06:01:05.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a5745bca-eef1-4058-80a6-c2764a843e1b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9042024-12-19T06:01:05.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a5745bca-eef1-4058-80a6-c2764a843e1b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9052024-12-19T06:01:05.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a5745bca-eef1-4058-80a6-c2764a843e1b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9062024-12-19T06:01:06.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fe14aa55-72ae-4ad2-81d6-c8cfd17a7d1f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9072024-12-19T06:01:06.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fe14aa55-72ae-4ad2-81d6-c8cfd17a7d1f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9082024-12-19T06:01:06.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fe14aa55-72ae-4ad2-81d6-c8cfd17a7d1f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9092024-12-19T06:01:08.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6c31394-b53d-4bd5-8ffe-9af228f663c3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9102024-12-19T06:01:08.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6c31394-b53d-4bd5-8ffe-9af228f663c3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9112024-12-19T06:01:08.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6c31394-b53d-4bd5-8ffe-9af228f663c3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
9122024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
9132024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
9142024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9152024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9162024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
9172024-12-19T06:01:08.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9182024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
9192024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9202024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9212024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
9222024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9232024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9242024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
9252024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
9262024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9272024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9282024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
9292024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9302024-12-19T06:01:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
9312024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9322024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
9332024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9342024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
9352024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9362024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
9372024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9382024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
9392024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9402024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
9412024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9422024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
9432024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9442024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
9452024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9462024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
9472024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9482024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9492024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9502024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9512024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9522024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9532024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9542024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9552024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9562024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9572024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9582024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9592024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9602024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9612024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9622024-12-19T06:01:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9632024-12-19T06:01:08.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642024-12-19T06:01:08.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9652024-12-19T06:01:08.766ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.601286ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9662024-12-19T06:01:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9672024-12-19T06:01:08.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9682024-12-19T06:01:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9692024-12-19T06:01:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9702024-12-19T06:01:08.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9712024-12-19T06:01:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9722024-12-19T06:01:08.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9732024-12-19T06:01:08.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9742024-12-19T06:01:08.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9752024-12-19T06:01:08.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9762024-12-19T06:01:08.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9772024-12-19T06:01:08.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1471, tv_nsec: 487335530 } })
9782024-12-19T06:01:08.772ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
9792024-12-19T06:01:08.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1471, tv_nsec: 489076176 } })
9802024-12-19T06:01:08.774ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
9812024-12-19T06:01:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9822024-12-19T06:01:08.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9832024-12-19T06:01:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9842024-12-19T06:01:08.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9852024-12-19T06:01:08.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1471, tv_nsec: 492748715 } })
9862024-12-19T06:01:08.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9872024-12-19T06:01:08.778ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
9882024-12-19T06:01:08.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9892024-12-19T06:01:08.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9902024-12-19T06:01:08.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9912024-12-19T06:01:08.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9922024-12-19T06:01:08.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9932024-12-19T06:01:08.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9942024-12-19T06:01:08.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9952024-12-19T06:01:08.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
9962024-12-19T06:01:08.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9972024-12-19T06:01:08.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9982024-12-19T06:01:08.799ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9992024-12-19T06:01:08.799ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10002024-12-19T06:01:08.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10012024-12-19T06:01:08.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10022024-12-19T06:01:08.805ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10032024-12-19T06:01:08.805ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10042024-12-19T06:01:08.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10052024-12-19T06:01:08.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10062024-12-19T06:01:08.807ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
10072024-12-19T06:01:08.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.770303ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
10082024-12-19T06:01:08.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.027223ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
10092024-12-19T06:01:08.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.5065ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
10102024-12-19T06:01:08.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10112024-12-19T06:01:08.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10122024-12-19T06:01:08.814ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10132024-12-19T06:01:08.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10142024-12-19T06:01:08.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10152024-12-19T06:01:08.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10162024-12-19T06:01:08.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.557895ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10172024-12-19T06:01:08.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10182024-12-19T06:01:08.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10192024-12-19T06:01:08.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10202024-12-19T06:01:08.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10212024-12-19T06:01:08.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10222024-12-19T06:01:08.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10232024-12-19T06:01:08.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10242024-12-19T06:01:08.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10252024-12-19T06:01:08.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10262024-12-19T06:01:08.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10272024-12-19T06:01:08.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10282024-12-19T06:01:08.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10292024-12-19T06:01:08.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10302024-12-19T06:01:08.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10312024-12-19T06:01:08.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10322024-12-19T06:01:08.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10332024-12-19T06:01:08.827ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10342024-12-19T06:01:08.827ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.415185ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10352024-12-19T06:01:08.842ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10362024-12-19T06:01:08.842ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10372024-12-19T06:01:08.842ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.824532ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10382024-12-19T06:01:08.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392024-12-19T06:01:08.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.586107ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10402024-12-19T06:01:08.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10412024-12-19T06:01:08.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10422024-12-19T06:01:08.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
10432024-12-19T06:01:08.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10442024-12-19T06:01:08.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10452024-12-19T06:01:08.852ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.212216ms iteration = 16 status = 0
10462024-12-19T06:01:08.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10472024-12-19T06:01:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10482024-12-19T06:01:08.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10492024-12-19T06:01:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10502024-12-19T06:01:08.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.719092ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10512024-12-19T06:01:08.862ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10522024-12-19T06:01:08.862ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10532024-12-19T06:01:08.862ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80f7cdff-b64a-4f6b-96d3-9bcd71fd7082", "content-length": "26", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
10542024-12-19T06:01:08.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10552024-12-19T06:01:08.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10562024-12-19T06:01:08.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
10572024-12-19T06:01:08.865ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10582024-12-19T06:01:08.865ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c61acbb6-dcae-4faa-91ff-8add96b2f453", "content-length": "26", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
10592024-12-19T06:01:08.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10602024-12-19T06:01:08.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10612024-12-19T06:01:08.866ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10622024-12-19T06:01:08.867ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0819f88b-a8a3-4091-9718-24c56c55ed48", "content-length": "26", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
10632024-12-19T06:01:08.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10642024-12-19T06:01:08.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
10652024-12-19T06:01:08.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10662024-12-19T06:01:08.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.765875ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
10672024-12-19T06:01:08.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10682024-12-19T06:01:08.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10692024-12-19T06:01:08.917ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10702024-12-19T06:01:08.917ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10712024-12-19T06:01:08.917ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "908c0adb-6309-4b11-9576-90aa61435d60", "content-length": "372", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
10722024-12-19T06:01:08.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10732024-12-19T06:01:08.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10742024-12-19T06:01:08.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10752024-12-19T06:01:08.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10762024-12-19T06:01:08.945ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.573462ms iteration = 18 status = {"physical_disks_added":0}
10772024-12-19T06:01:08.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10782024-12-19T06:01:08.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10792024-12-19T06:01:08.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10802024-12-19T06:01:08.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10812024-12-19T06:01:08.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822024-12-19T06:01:08.952ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10832024-12-19T06:01:08.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10842024-12-19T06:01:08.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10852024-12-19T06:01:08.959ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.595563ms iteration = 16 status = {}
10862024-12-19T06:01:08.962ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10872024-12-19T06:01:08.963ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2fa7d12-ca0c-4879-add0-bc7e9ee1d870", "content-length": "1", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
10882024-12-19T06:01:08.964ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10892024-12-19T06:01:08.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10902024-12-19T06:01:08.966ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.548418ms iteration = 16 status = null
10912024-12-19T06:01:08.967ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
10922024-12-19T06:01:08.967ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10932024-12-19T06:01:08.967ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f0e626d2-fc45-4017-928c-b94fa7e8f044", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
10942024-12-19T06:01:08.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10952024-12-19T06:01:08.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10962024-12-19T06:01:08.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10972024-12-19T06:01:08.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10982024-12-19T06:01:08.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10992024-12-19T06:01:08.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11002024-12-19T06:01:08.975ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11012024-12-19T06:01:08.975ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11022024-12-19T06:01:08.976ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2232e65f-cf7a-4fdd-b1a1-704d38e6979c", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
11032024-12-19T06:01:08.978ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 215.389028ms iteration = 16 status = {}
11042024-12-19T06:01:08.996ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11052024-12-19T06:01:08.997ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbcb7af8-0a69-448b-8e66-d7ddd6a949af", "content-length": "691", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
11062024-12-19T06:01:08.997ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11072024-12-19T06:01:08.997ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11082024-12-19T06:01:08.997ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11092024-12-19T06:01:08.997ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 235.051142ms iteration = 16 status = {}
11102024-12-19T06:01:09.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11112024-12-19T06:01:09.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11122024-12-19T06:01:09.030ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
11132024-12-19T06:01:09.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11142024-12-19T06:01:09.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11152024-12-19T06:01:09.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9dec1d44-241c-4694-9e3e-2a52ea507c73 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11162024-12-19T06:01:09.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9dec1d44-241c-4694-9e3e-2a52ea507c73 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11172024-12-19T06:01:09.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9dec1d44-241c-4694-9e3e-2a52ea507c73 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11182024-12-19T06:01:09.039ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11192024-12-19T06:01:09.039ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c79a29b-18c6-4444-b9fe-1d425d2064b7", "content-length": "134", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
11202024-12-19T06:01:09.039ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11212024-12-19T06:01:09.039ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
11222024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11232024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11242024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11252024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11262024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11272024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11282024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11292024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11302024-12-19T06:01:09.040ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
11312024-12-19T06:01:09.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11322024-12-19T06:01:09.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11332024-12-19T06:01:09.042ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11342024-12-19T06:01:09.042ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d82093dd-ded3-4dcc-a0dd-ee34c491269c", "content-length": "2", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
11352024-12-19T06:01:09.042ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11362024-12-19T06:01:09.042ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a8bd760-0e42-449a-b67f-fd692309e494", "content-length": "52", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
11372024-12-19T06:01:09.042ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
11382024-12-19T06:01:09.042ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11392024-12-19T06:01:09.143ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f1df0962-9c99-4e4a-b11a-c33f6bbf2cca", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
11402024-12-19T06:01:09.143ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
11412024-12-19T06:01:09.143ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11422024-12-19T06:01:09.143ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a714d397-5cd9-42e9-8747-719c8360bea5", "content-length": "682", "date": "Thu, 19 Dec 2024 06:01:08 GMT"} })
11432024-12-19T06:01:09.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11442024-12-19T06:01:09.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11452024-12-19T06:01:09.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11462024-12-19T06:01:09.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11472024-12-19T06:01:09.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11482024-12-19T06:01:09.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11492024-12-19T06:01:09.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11502024-12-19T06:01:09.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11512024-12-19T06:01:09.162ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 399.78212ms iteration = 16 status = {}
11522024-12-19T06:01:10.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2394c47f-bc0d-4717-9c15-ae531e18db6d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11532024-12-19T06:01:10.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2394c47f-bc0d-4717-9c15-ae531e18db6d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11542024-12-19T06:01:10.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2394c47f-bc0d-4717-9c15-ae531e18db6d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11552024-12-19T06:01:11.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9743d7fb-7243-4a71-b6af-9908170212a2 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11562024-12-19T06:01:11.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9743d7fb-7243-4a71-b6af-9908170212a2 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11572024-12-19T06:01:11.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9743d7fb-7243-4a71-b6af-9908170212a2 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11582024-12-19T06:01:12.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b16ea1ec-83c1-4fd2-84b7-e8bc1c281022 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11592024-12-19T06:01:12.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b16ea1ec-83c1-4fd2-84b7-e8bc1c281022 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11602024-12-19T06:01:12.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b16ea1ec-83c1-4fd2-84b7-e8bc1c281022 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11612024-12-19T06:01:13.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1945b9ef-d4be-4639-8612-f6b166c8ba72 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11622024-12-19T06:01:13.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1945b9ef-d4be-4639-8612-f6b166c8ba72 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11632024-12-19T06:01:13.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1945b9ef-d4be-4639-8612-f6b166c8ba72 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11642024-12-19T06:01:14.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e7fef6b1-5ccf-4ede-80de-751441e3cd1c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11652024-12-19T06:01:14.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e7fef6b1-5ccf-4ede-80de-751441e3cd1c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11662024-12-19T06:01:14.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e7fef6b1-5ccf-4ede-80de-751441e3cd1c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11672024-12-19T06:01:14.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 0acc313e-a594-4f1b-b3d1-38e8c780b427 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
11682024-12-19T06:01:14.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 0acc313e-a594-4f1b-b3d1-38e8c780b427 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
11692024-12-19T06:01:14.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 0acc313e-a594-4f1b-b3d1-38e8c780b427 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
11702024-12-19T06:01:14.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 3d878e83-2382-4da8-a1b5-69df60177e90 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
11712024-12-19T06:01:14.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 3d878e83-2382-4da8-a1b5-69df60177e90 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
11722024-12-19T06:01:14.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 3d878e83-2382-4da8-a1b5-69df60177e90 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
11732024-12-19T06:01:14.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 417 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 14a70f12-40e0-471e-9ac1-e378ea5505af response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
11742024-12-19T06:01:15.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ba6d0c96-e864-4e6d-a9bc-074cdd6749cf roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11752024-12-19T06:01:15.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ba6d0c96-e864-4e6d-a9bc-074cdd6749cf resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11762024-12-19T06:01:15.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ba6d0c96-e864-4e6d-a9bc-074cdd6749cf response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11772024-12-19T06:01:16.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 29ad10f9-a175-4fda-b6da-ea59d58904fe roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11782024-12-19T06:01:16.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 29ad10f9-a175-4fda-b6da-ea59d58904fe resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11792024-12-19T06:01:16.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 29ad10f9-a175-4fda-b6da-ea59d58904fe response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11802024-12-19T06:01:17.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 74682057-532a-43cf-81a7-c115412e9c38 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11812024-12-19T06:01:17.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 74682057-532a-43cf-81a7-c115412e9c38 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11822024-12-19T06:01:17.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 74682057-532a-43cf-81a7-c115412e9c38 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11832024-12-19T06:01:18.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 99d916eb-4aff-4e79-8362-53a854dd7538 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11842024-12-19T06:01:18.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 99d916eb-4aff-4e79-8362-53a854dd7538 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11852024-12-19T06:01:18.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 99d916eb-4aff-4e79-8362-53a854dd7538 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
11862024-12-19T06:01:18.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
11872024-12-19T06:01:18.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
11882024-12-19T06:01:18.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11892024-12-19T06:01:18.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11902024-12-19T06:01:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11912024-12-19T06:01:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11922024-12-19T06:01:18.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11932024-12-19T06:01:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11942024-12-19T06:01:18.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11952024-12-19T06:01:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11962024-12-19T06:01:18.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11972024-12-19T06:01:18.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11982024-12-19T06:01:18.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11992024-12-19T06:01:18.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
12002024-12-19T06:01:18.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12012024-12-19T06:01:18.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12022024-12-19T06:01:18.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
12032024-12-19T06:01:18.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.881547ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
12042024-12-19T06:01:18.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12052024-12-19T06:01:18.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12062024-12-19T06:01:18.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.449861ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12072024-12-19T06:01:19.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b4eed6cf-8aaf-438f-9c2a-e16c249017ea roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12082024-12-19T06:01:19.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b4eed6cf-8aaf-438f-9c2a-e16c249017ea resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12092024-12-19T06:01:19.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b4eed6cf-8aaf-438f-9c2a-e16c249017ea response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12102024-12-19T06:01:20.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 44490d29-cc02-45f6-a369-1958a2e58f76 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12112024-12-19T06:01:20.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 44490d29-cc02-45f6-a369-1958a2e58f76 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12122024-12-19T06:01:20.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 44490d29-cc02-45f6-a369-1958a2e58f76 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12132024-12-19T06:01:21.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b0b4fb3d-7918-49af-8151-ae39e2456f35 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12142024-12-19T06:01:21.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b0b4fb3d-7918-49af-8151-ae39e2456f35 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12152024-12-19T06:01:21.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b0b4fb3d-7918-49af-8151-ae39e2456f35 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12162024-12-19T06:01:22.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a09630aa-b5a7-4d31-b853-4a3c7e4e95a0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12172024-12-19T06:01:22.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a09630aa-b5a7-4d31-b853-4a3c7e4e95a0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12182024-12-19T06:01:22.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a09630aa-b5a7-4d31-b853-4a3c7e4e95a0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12192024-12-19T06:01:23.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3b91c33d-e8ae-4651-9c20-b29fec645517 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12202024-12-19T06:01:23.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3b91c33d-e8ae-4651-9c20-b29fec645517 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12212024-12-19T06:01:23.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3b91c33d-e8ae-4651-9c20-b29fec645517 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12222024-12-19T06:01:24.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c5af9e55-a372-4231-8ca2-163a03a54d39 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12232024-12-19T06:01:24.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c5af9e55-a372-4231-8ca2-163a03a54d39 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12242024-12-19T06:01:24.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c5af9e55-a372-4231-8ca2-163a03a54d39 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12252024-12-19T06:01:24.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = a3b56d9e-007e-4aaf-a45e-07a1adc846c3 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
12262024-12-19T06:01:25.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c8a9e234-f728-49a9-b4fd-45959de12b19 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12272024-12-19T06:01:25.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c8a9e234-f728-49a9-b4fd-45959de12b19 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12282024-12-19T06:01:25.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c8a9e234-f728-49a9-b4fd-45959de12b19 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12292024-12-19T06:01:26.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fcd54e46-fec1-4f7a-aac3-6827922188da roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12302024-12-19T06:01:26.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fcd54e46-fec1-4f7a-aac3-6827922188da resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12312024-12-19T06:01:26.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fcd54e46-fec1-4f7a-aac3-6827922188da response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12322024-12-19T06:01:27.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df5c99db-f818-457b-90d6-a97a1a949f98 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12332024-12-19T06:01:27.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df5c99db-f818-457b-90d6-a97a1a949f98 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12342024-12-19T06:01:27.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df5c99db-f818-457b-90d6-a97a1a949f98 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12352024-12-19T06:01:28.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1e6679c8-f710-428f-91bd-f170d3943ffb roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12362024-12-19T06:01:28.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1e6679c8-f710-428f-91bd-f170d3943ffb resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12372024-12-19T06:01:28.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1e6679c8-f710-428f-91bd-f170d3943ffb response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12382024-12-19T06:01:28.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
12392024-12-19T06:01:28.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
12402024-12-19T06:01:28.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12412024-12-19T06:01:28.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12422024-12-19T06:01:28.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12432024-12-19T06:01:28.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12442024-12-19T06:01:28.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12452024-12-19T06:01:28.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12462024-12-19T06:01:28.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12472024-12-19T06:01:28.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.793954ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12482024-12-19T06:01:28.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12492024-12-19T06:01:28.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12502024-12-19T06:01:28.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12512024-12-19T06:01:28.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12522024-12-19T06:01:28.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12532024-12-19T06:01:28.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12542024-12-19T06:01:28.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
12552024-12-19T06:01:28.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12562024-12-19T06:01:28.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12572024-12-19T06:01:28.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
12582024-12-19T06:01:28.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.30417ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
12592024-12-19T06:01:29.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cff59f45-de12-4fe5-a03d-640820b0d2d9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12602024-12-19T06:01:29.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cff59f45-de12-4fe5-a03d-640820b0d2d9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12612024-12-19T06:01:29.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cff59f45-de12-4fe5-a03d-640820b0d2d9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12622024-12-19T06:01:30.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 582c03a9-9a8c-4152-8433-82dd3d5ff9f7 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12632024-12-19T06:01:30.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 582c03a9-9a8c-4152-8433-82dd3d5ff9f7 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12642024-12-19T06:01:30.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 582c03a9-9a8c-4152-8433-82dd3d5ff9f7 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12652024-12-19T06:01:31.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 32757f87-730f-46e1-9947-742053aae342 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12662024-12-19T06:01:31.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 32757f87-730f-46e1-9947-742053aae342 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12672024-12-19T06:01:31.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 32757f87-730f-46e1-9947-742053aae342 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12682024-12-19T06:01:32.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3adb60cd-ece3-4dfa-9d48-8f9fa7ac9dfe roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12692024-12-19T06:01:32.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3adb60cd-ece3-4dfa-9d48-8f9fa7ac9dfe resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12702024-12-19T06:01:32.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3adb60cd-ece3-4dfa-9d48-8f9fa7ac9dfe response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12712024-12-19T06:01:33.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9d27e729-f3ff-48b7-9f6c-46a725d0e5f8 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12722024-12-19T06:01:33.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9d27e729-f3ff-48b7-9f6c-46a725d0e5f8 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12732024-12-19T06:01:33.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9d27e729-f3ff-48b7-9f6c-46a725d0e5f8 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12742024-12-19T06:01:34.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab4fc45c-1eb6-495f-9a46-fcbb6a33ab42 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12752024-12-19T06:01:34.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab4fc45c-1eb6-495f-9a46-fcbb6a33ab42 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12762024-12-19T06:01:34.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ab4fc45c-1eb6-495f-9a46-fcbb6a33ab42 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12772024-12-19T06:01:34.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = c1331632-4d66-40e7-9fc5-3d1d7e669a15 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
12782024-12-19T06:01:35.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 475ee283-eeba-474b-95db-e2f8349c7ef4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12792024-12-19T06:01:35.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 475ee283-eeba-474b-95db-e2f8349c7ef4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12802024-12-19T06:01:35.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 475ee283-eeba-474b-95db-e2f8349c7ef4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12812024-12-19T06:01:36.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1582fb6-5b8b-4b3d-b730-8c114535954e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12822024-12-19T06:01:36.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1582fb6-5b8b-4b3d-b730-8c114535954e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12832024-12-19T06:01:36.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1582fb6-5b8b-4b3d-b730-8c114535954e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12842024-12-19T06:01:37.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 11e9bc80-0fb3-40d7-aad0-93617d4ae5da roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12852024-12-19T06:01:37.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 11e9bc80-0fb3-40d7-aad0-93617d4ae5da resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12862024-12-19T06:01:37.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 11e9bc80-0fb3-40d7-aad0-93617d4ae5da response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
12872024-12-19T06:01:38.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
12882024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12892024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
12902024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
12912024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12922024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
12932024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12942024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12952024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
12962024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
12972024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
12982024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12992024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
13002024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13012024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13022024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
13032024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
13042024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13052024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
13062024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13072024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
13082024-12-19T06:01:38.762ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ec4c486a-8de5-4892-b4b1-13175064de2e
13092024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
13102024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.441\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e"}
13112024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
13122024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
13132024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13142024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
13152024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
13162024-12-19T06:01:38.762ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 05:51:38.762277159 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13172024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13182024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13192024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
13202024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
13212024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13222024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
13232024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13242024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13252024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13262024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
13272024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13282024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
13292024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13302024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13312024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
13322024-12-19T06:01:38.762ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13332024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13342024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
13352024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13362024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
13372024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
13382024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
13392024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
13402024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13412024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13422024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
13432024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13442024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
13452024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13462024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
13472024-12-19T06:01:38.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13482024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13492024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13502024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13512024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13522024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13532024-12-19T06:01:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
13542024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13552024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13562024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13572024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
13582024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13592024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13602024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13612024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13622024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13632024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13642024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13652024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13662024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13672024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13682024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13692024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13702024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13712024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13722024-12-19T06:01:38.763ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ecedc0eb-6c7d-4958-9fee-747c67187e55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1501, tv_nsec: 478355371 } })
13732024-12-19T06:01:38.763ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("75a56219-191b-4e5c-8eb1-d0e62e0c42f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1501, tv_nsec: 478377641 } })
13742024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13752024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
13762024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.378595ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
13772024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
13782024-12-19T06:01:38.763ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.766857ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
13792024-12-19T06:01:38.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13802024-12-19T06:01:38.766ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.909316ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13812024-12-19T06:01:38.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13822024-12-19T06:01:38.767ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.248089ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
13832024-12-19T06:01:38.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13842024-12-19T06:01:38.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852024-12-19T06:01:38.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13862024-12-19T06:01:38.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13872024-12-19T06:01:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13882024-12-19T06:01:38.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13892024-12-19T06:01:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13902024-12-19T06:01:38.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13912024-12-19T06:01:38.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13922024-12-19T06:01:38.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13932024-12-19T06:01:38.772ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13942024-12-19T06:01:38.772ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13952024-12-19T06:01:38.772ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.886899ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13962024-12-19T06:01:38.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13972024-12-19T06:01:38.776ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982024-12-19T06:01:38.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1501, tv_nsec: 492018711 } })
13992024-12-19T06:01:38.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14002024-12-19T06:01:38.777ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012024-12-19T06:01:38.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14022024-12-19T06:01:38.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14032024-12-19T06:01:38.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14042024-12-19T06:01:38.779ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14052024-12-19T06:01:38.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14062024-12-19T06:01:38.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14072024-12-19T06:01:38.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14082024-12-19T06:01:38.780ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14092024-12-19T06:01:38.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14102024-12-19T06:01:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14112024-12-19T06:01:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14122024-12-19T06:01:38.782ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14132024-12-19T06:01:38.782ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14142024-12-19T06:01:38.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14152024-12-19T06:01:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14162024-12-19T06:01:38.783ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 05:51:38.762277159 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14172024-12-19T06:01:38.783ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1501, tv_nsec: 498266902 } })
14182024-12-19T06:01:38.783ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.991456ms iteration = 9 status = {"expiration":"2024-12-19T05:51:38.762277159Z","pruned":[]}
14192024-12-19T06:01:38.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14202024-12-19T06:01:38.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14212024-12-19T06:01:38.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14222024-12-19T06:01:38.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14232024-12-19T06:01:38.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14242024-12-19T06:01:38.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14252024-12-19T06:01:38.789ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 27.673821ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14262024-12-19T06:01:38.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14272024-12-19T06:01:38.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14282024-12-19T06:01:38.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14292024-12-19T06:01:38.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14302024-12-19T06:01:38.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14312024-12-19T06:01:38.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14322024-12-19T06:01:38.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14332024-12-19T06:01:38.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14342024-12-19T06:01:38.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14352024-12-19T06:01:38.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14362024-12-19T06:01:38.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14372024-12-19T06:01:38.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14382024-12-19T06:01:38.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14392024-12-19T06:01:38.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402024-12-19T06:01:38.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412024-12-19T06:01:38.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14422024-12-19T06:01:38.798ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1501, tv_nsec: 513788632 } })
14432024-12-19T06:01:38.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
14442024-12-19T06:01:38.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.441036ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
14452024-12-19T06:01:38.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14462024-12-19T06:01:38.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14472024-12-19T06:01:38.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14482024-12-19T06:01:38.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14492024-12-19T06:01:38.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
14502024-12-19T06:01:38.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14512024-12-19T06:01:38.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14522024-12-19T06:01:38.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14532024-12-19T06:01:38.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14542024-12-19T06:01:38.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14552024-12-19T06:01:38.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14562024-12-19T06:01:38.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.033762ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
14572024-12-19T06:01:38.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14582024-12-19T06:01:38.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14592024-12-19T06:01:38.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14602024-12-19T06:01:38.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14612024-12-19T06:01:38.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14622024-12-19T06:01:38.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14632024-12-19T06:01:38.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14642024-12-19T06:01:38.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.261561ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14652024-12-19T06:01:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14662024-12-19T06:01:38.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14672024-12-19T06:01:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14682024-12-19T06:01:38.823ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14692024-12-19T06:01:38.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14702024-12-19T06:01:38.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.243723ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14712024-12-19T06:01:38.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14722024-12-19T06:01:38.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14732024-12-19T06:01:38.830ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
14742024-12-19T06:01:38.831ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.932331ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
14752024-12-19T06:01:38.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762024-12-19T06:01:38.833ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14772024-12-19T06:01:38.833ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14782024-12-19T06:01:38.833ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14792024-12-19T06:01:38.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14802024-12-19T06:01:38.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14812024-12-19T06:01:38.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14822024-12-19T06:01:38.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14832024-12-19T06:01:38.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14842024-12-19T06:01:38.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14852024-12-19T06:01:38.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14862024-12-19T06:01:38.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8c782633-8be8-44f8-b08e-b60e010e3e69 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
14872024-12-19T06:01:38.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14882024-12-19T06:01:38.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8c782633-8be8-44f8-b08e-b60e010e3e69 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
14892024-12-19T06:01:38.836ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14902024-12-19T06:01:38.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.8594ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14912024-12-19T06:01:38.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14922024-12-19T06:01:38.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8c782633-8be8-44f8-b08e-b60e010e3e69 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
14932024-12-19T06:01:38.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14942024-12-19T06:01:38.838ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14952024-12-19T06:01:38.838ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14962024-12-19T06:01:38.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14972024-12-19T06:01:38.838ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14982024-12-19T06:01:38.838ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
14992024-12-19T06:01:38.838ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.128923ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15002024-12-19T06:01:38.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15012024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15022024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15032024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15042024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15052024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15062024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15072024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15082024-12-19T06:01:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15092024-12-19T06:01:38.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15102024-12-19T06:01:38.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
15112024-12-19T06:01:38.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15122024-12-19T06:01:38.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15132024-12-19T06:01:38.844ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 81.981781ms iteration = 19 status = {"physical_disks_added":0}
15142024-12-19T06:01:38.846ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.208284ms iteration = 17 status = 0
15152024-12-19T06:01:38.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15162024-12-19T06:01:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15172024-12-19T06:01:38.858ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15182024-12-19T06:01:38.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15192024-12-19T06:01:38.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15202024-12-19T06:01:38.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.97236ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
15212024-12-19T06:01:38.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-12-19T06:01:38.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15232024-12-19T06:01:38.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15242024-12-19T06:01:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15252024-12-19T06:01:38.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15262024-12-19T06:01:38.886ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15272024-12-19T06:01:38.886ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15282024-12-19T06:01:38.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.535992ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15292024-12-19T06:01:38.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15302024-12-19T06:01:38.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15312024-12-19T06:01:38.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15322024-12-19T06:01:38.889ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15332024-12-19T06:01:38.889ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15342024-12-19T06:01:38.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15352024-12-19T06:01:38.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15362024-12-19T06:01:38.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15372024-12-19T06:01:38.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15382024-12-19T06:01:38.905ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15392024-12-19T06:01:38.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15402024-12-19T06:01:38.912ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15412024-12-19T06:01:38.912ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "957e8f49-5883-46ba-8d98-da5707e9f8e9", "content-length": "26", "date": "Thu, 19 Dec 2024 06:01:38 GMT"} })
15422024-12-19T06:01:38.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15432024-12-19T06:01:38.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15442024-12-19T06:01:38.919ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15452024-12-19T06:01:38.919ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 0 version = 2
15462024-12-19T06:01:38.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15472024-12-19T06:01:38.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15482024-12-19T06:01:38.922ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T05:53:28.550897Z, time_modified: 2024-12-19T05:53:28.550897Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }) }
15492024-12-19T06:01:38.922ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 159.641593ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]}},"default_endpoint":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15502024-12-19T06:01:38.958ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
15512024-12-19T06:01:38.958ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 196.351016ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15522024-12-19T06:01:38.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15532024-12-19T06:01:38.959ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15542024-12-19T06:01:38.959ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d9a9687-2730-4e81-b336-662010d4a1d6", "content-length": "26", "date": "Thu, 19 Dec 2024 06:01:38 GMT"} })
15552024-12-19T06:01:38.959ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15562024-12-19T06:01:38.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15572024-12-19T06:01:39.035ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15582024-12-19T06:01:39.036ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "766535a1-780b-4fe7-a5a3-f1f02f5a46e3", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15592024-12-19T06:01:39.036ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15602024-12-19T06:01:39.037ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "93c68c26-7237-451e-bfff-6222b35d873a", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15612024-12-19T06:01:39.037ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15622024-12-19T06:01:39.038ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15632024-12-19T06:01:39.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 276.752916ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15642024-12-19T06:01:39.043ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15652024-12-19T06:01:39.043ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15662024-12-19T06:01:39.043ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f14158b1-d37e-4c6a-a666-5c3d956d6560", "content-length": "372", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} })
15672024-12-19T06:01:39.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15682024-12-19T06:01:39.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15692024-12-19T06:01:39.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702024-12-19T06:01:39.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-12-19T06:01:39.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15722024-12-19T06:01:39.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15732024-12-19T06:01:39.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15742024-12-19T06:01:39.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15752024-12-19T06:01:39.078ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15762024-12-19T06:01:39.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15772024-12-19T06:01:39.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15782024-12-19T06:01:39.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15792024-12-19T06:01:39.079ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "81f367f1-9c7f-4437-9b84-67cc51c8206c", "content-length": "1", "date": "Thu, 19 Dec 2024 06:01:38 GMT"} })
15802024-12-19T06:01:39.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15812024-12-19T06:01:39.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15822024-12-19T06:01:39.081ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15832024-12-19T06:01:39.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15842024-12-19T06:01:39.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15852024-12-19T06:01:39.081ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
15862024-12-19T06:01:39.081ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15872024-12-19T06:01:39.081ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 05:54:06.714960 UTC dns_group = internal generation = 1
15882024-12-19T06:01:39.081ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 319.249175ms iteration = 9 status = {"generation":1}
15892024-12-19T06:01:39.082ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 1 version = 2
15902024-12-19T06:01:39.082ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15912024-12-19T06:01:39.082ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 05:54:07.672295 UTC dns_group = external generation = 2
15922024-12-19T06:01:39.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 320.557127ms iteration = 9 status = {"generation":2}
15932024-12-19T06:01:39.083ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 320.950639ms iteration = 17 status = null
15942024-12-19T06:01:39.088ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
15952024-12-19T06:01:39.088ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15962024-12-19T06:01:39.088ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2aa3def-8b24-44d2-81e1-db520d33a7af", "content-length": "26", "date": "Thu, 19 Dec 2024 06:01:38 GMT"} })
15972024-12-19T06:01:39.088ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15982024-12-19T06:01:39.090ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
15992024-12-19T06:01:39.091ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16002024-12-19T06:01:39.091ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16012024-12-19T06:01:39.091ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bfe22172-e269-4dba-b04a-87fdb8d28abd", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} })
16022024-12-19T06:01:39.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16032024-12-19T06:01:39.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16042024-12-19T06:01:39.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16052024-12-19T06:01:39.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16062024-12-19T06:01:39.096ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.600557ms iteration = 17 status = {}
16072024-12-19T06:01:39.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16082024-12-19T06:01:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16092024-12-19T06:01:39.100ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16102024-12-19T06:01:39.100ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16112024-12-19T06:01:39.101ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7fccf67d-a318-4b00-afbf-d1a8af91a7ae", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} })
16122024-12-19T06:01:39.102ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 340.186569ms iteration = 17 status = {}
16132024-12-19T06:01:39.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16142024-12-19T06:01:39.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16152024-12-19T06:01:39.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16162024-12-19T06:01:39.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16172024-12-19T06:01:39.114ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16182024-12-19T06:01:39.173ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16192024-12-19T06:01:39.173ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "aa96fa4c-8c75-4116-ad60-e79e22e394a5", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16202024-12-19T06:01:39.173ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16212024-12-19T06:01:39.176ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7f7f0d53-2bd6-4739-8c6d-2653682d20f4", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16222024-12-19T06:01:39.176ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16232024-12-19T06:01:39.177ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b647445b-561d-4cbc-b7a2-e01509899380", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16242024-12-19T06:01:39.177ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16252024-12-19T06:01:39.179ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16262024-12-19T06:01:39.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 417.308224ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16272024-12-19T06:01:39.207ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16282024-12-19T06:01:39.208ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef39893-b168-46a5-ba6d-b2e7a577d0c5", "content-length": "691", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} })
16292024-12-19T06:01:39.208ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16302024-12-19T06:01:39.208ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16312024-12-19T06:01:39.208ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16322024-12-19T06:01:39.210ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 448.346825ms iteration = 17 status = {}
16332024-12-19T06:01:39.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16342024-12-19T06:01:39.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16352024-12-19T06:01:39.232ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
16362024-12-19T06:01:39.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16372024-12-19T06:01:39.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16382024-12-19T06:01:39.241ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16392024-12-19T06:01:39.242ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce590191-26b6-4ab1-87cb-c0caa6563fa7", "content-length": "134", "date": "Thu, 19 Dec 2024 06:01:38 GMT"} })
16402024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16412024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
16422024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16432024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16442024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16452024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16462024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16472024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16482024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16492024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16502024-12-19T06:01:39.242ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
16512024-12-19T06:01:39.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16522024-12-19T06:01:39.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16532024-12-19T06:01:39.244ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16542024-12-19T06:01:39.244ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2113fa4-ea67-47bf-8c89-77a9df5accc7", "content-length": "2", "date": "Thu, 19 Dec 2024 06:01:38 GMT"} })
16552024-12-19T06:01:39.244ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16562024-12-19T06:01:39.244ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cba9bf24-4267-4e71-8c0f-038de79fe0ed", "content-length": "52", "date": "Thu, 19 Dec 2024 06:01:38 GMT"} })
16572024-12-19T06:01:39.244ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
16582024-12-19T06:01:39.244ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16592024-12-19T06:01:39.346ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08830711-2fc3-4780-8da6-cb196428139c", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} })
16602024-12-19T06:01:39.346ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
16612024-12-19T06:01:39.346ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16622024-12-19T06:01:39.346ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d967090-b11d-4555-b511-56a21bbd116b", "content-length": "682", "date": "Thu, 19 Dec 2024 06:01:39 GMT"} })
16632024-12-19T06:01:39.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16642024-12-19T06:01:39.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16652024-12-19T06:01:39.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16662024-12-19T06:01:39.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16672024-12-19T06:01:39.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16682024-12-19T06:01:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16692024-12-19T06:01:39.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16702024-12-19T06:01:39.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16712024-12-19T06:01:39.362ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 600.396353ms iteration = 17 status = {}
16722024-12-19T06:01:39.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 990765ac-b7a1-4282-aa54-c3f381f00fbd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16732024-12-19T06:01:39.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 990765ac-b7a1-4282-aa54-c3f381f00fbd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16742024-12-19T06:01:39.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 990765ac-b7a1-4282-aa54-c3f381f00fbd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16752024-12-19T06:01:40.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f38195c0-16e1-462d-a5a7-facc1c6b2e4b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16762024-12-19T06:01:40.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f38195c0-16e1-462d-a5a7-facc1c6b2e4b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16772024-12-19T06:01:40.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f38195c0-16e1-462d-a5a7-facc1c6b2e4b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16782024-12-19T06:01:41.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8455b34-276a-4c9e-979b-d503aa4117ff roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16792024-12-19T06:01:41.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8455b34-276a-4c9e-979b-d503aa4117ff resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16802024-12-19T06:01:41.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8455b34-276a-4c9e-979b-d503aa4117ff response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16812024-12-19T06:01:42.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 808913cc-7f0b-4117-9baa-e9f168007e37 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16822024-12-19T06:01:42.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 808913cc-7f0b-4117-9baa-e9f168007e37 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16832024-12-19T06:01:42.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 808913cc-7f0b-4117-9baa-e9f168007e37 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16842024-12-19T06:01:43.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dda7cd73-da84-46c1-8583-00f156c14512 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16852024-12-19T06:01:43.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dda7cd73-da84-46c1-8583-00f156c14512 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16862024-12-19T06:01:43.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dda7cd73-da84-46c1-8583-00f156c14512 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16872024-12-19T06:01:44.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6264a311-662d-4032-9d07-c600d1b36b31 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16882024-12-19T06:01:44.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6264a311-662d-4032-9d07-c600d1b36b31 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16892024-12-19T06:01:44.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6264a311-662d-4032-9d07-c600d1b36b31 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16902024-12-19T06:01:44.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 29b8114d-5c97-47b0-a62d-72e1d7071444 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
16912024-12-19T06:01:46.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7ae997ca-cb44-456a-8455-90a0f9e8d23f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16922024-12-19T06:01:46.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7ae997ca-cb44-456a-8455-90a0f9e8d23f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16932024-12-19T06:01:46.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7ae997ca-cb44-456a-8455-90a0f9e8d23f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16942024-12-19T06:01:47.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8e33c2e-6baa-45dc-b603-57a84d343cd7 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16952024-12-19T06:01:47.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8e33c2e-6baa-45dc-b603-57a84d343cd7 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16962024-12-19T06:01:47.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8e33c2e-6baa-45dc-b603-57a84d343cd7 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16972024-12-19T06:01:48.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7a6d6831-104d-4cfb-8002-711a7876fabe roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16982024-12-19T06:01:48.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7a6d6831-104d-4cfb-8002-711a7876fabe resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
16992024-12-19T06:01:48.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7a6d6831-104d-4cfb-8002-711a7876fabe response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17002024-12-19T06:01:48.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
17012024-12-19T06:01:48.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
17022024-12-19T06:01:48.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17032024-12-19T06:01:48.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17042024-12-19T06:01:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17052024-12-19T06:01:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17062024-12-19T06:01:48.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072024-12-19T06:01:48.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17082024-12-19T06:01:48.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17092024-12-19T06:01:48.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17102024-12-19T06:01:48.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17112024-12-19T06:01:48.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17122024-12-19T06:01:48.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17132024-12-19T06:01:48.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17142024-12-19T06:01:48.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152024-12-19T06:01:48.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
17162024-12-19T06:01:48.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17172024-12-19T06:01:48.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17182024-12-19T06:01:48.813ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
17192024-12-19T06:01:48.813ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.779656ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
17202024-12-19T06:01:48.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.699261ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17212024-12-19T06:01:49.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8b6911a3-9db9-4c31-a7bd-c4bfd8b40411 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17222024-12-19T06:01:49.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8b6911a3-9db9-4c31-a7bd-c4bfd8b40411 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17232024-12-19T06:01:49.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8b6911a3-9db9-4c31-a7bd-c4bfd8b40411 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17242024-12-19T06:01:50.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 51111e09-bc76-4f87-bb5d-8518ae4e3df1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17252024-12-19T06:01:50.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 51111e09-bc76-4f87-bb5d-8518ae4e3df1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17262024-12-19T06:01:50.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 51111e09-bc76-4f87-bb5d-8518ae4e3df1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17272024-12-19T06:01:51.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 04110adc-46ac-427c-b1fa-d19557372f22 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17282024-12-19T06:01:51.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 04110adc-46ac-427c-b1fa-d19557372f22 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17292024-12-19T06:01:51.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 04110adc-46ac-427c-b1fa-d19557372f22 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17302024-12-19T06:01:52.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9c0ac18a-fbcc-419e-b9b2-f2f6a11ed5be roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17312024-12-19T06:01:52.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9c0ac18a-fbcc-419e-b9b2-f2f6a11ed5be resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17322024-12-19T06:01:52.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9c0ac18a-fbcc-419e-b9b2-f2f6a11ed5be response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17332024-12-19T06:01:53.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aa49ac4a-540f-499c-9c87-0c06c79afbf1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17342024-12-19T06:01:53.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aa49ac4a-540f-499c-9c87-0c06c79afbf1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17352024-12-19T06:01:53.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aa49ac4a-540f-499c-9c87-0c06c79afbf1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17362024-12-19T06:01:54.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c157ba45-ea4d-4f26-a9a4-483baf085cf6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17372024-12-19T06:01:54.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c157ba45-ea4d-4f26-a9a4-483baf085cf6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17382024-12-19T06:01:54.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c157ba45-ea4d-4f26-a9a4-483baf085cf6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17392024-12-19T06:01:54.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 427 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = a00b5f80-196b-420d-a98f-3c9726e72497 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
17402024-12-19T06:01:55.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec1ded04-cd93-4652-be5d-618cb1715a23 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17412024-12-19T06:01:55.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec1ded04-cd93-4652-be5d-618cb1715a23 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17422024-12-19T06:01:55.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec1ded04-cd93-4652-be5d-618cb1715a23 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17432024-12-19T06:01:56.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9cb0d381-32be-44c6-8fda-c4f10bb0c9aa roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17442024-12-19T06:01:56.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9cb0d381-32be-44c6-8fda-c4f10bb0c9aa resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17452024-12-19T06:01:56.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9cb0d381-32be-44c6-8fda-c4f10bb0c9aa response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17462024-12-19T06:01:57.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 228bcbf5-b962-4c7a-9ddc-3c8e55461a27 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17472024-12-19T06:01:57.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 228bcbf5-b962-4c7a-9ddc-3c8e55461a27 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17482024-12-19T06:01:57.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 228bcbf5-b962-4c7a-9ddc-3c8e55461a27 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17492024-12-19T06:01:58.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 418a018c-59ba-414b-9546-b974f84e6856 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17502024-12-19T06:01:58.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 418a018c-59ba-414b-9546-b974f84e6856 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17512024-12-19T06:01:58.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 418a018c-59ba-414b-9546-b974f84e6856 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17522024-12-19T06:01:58.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
17532024-12-19T06:01:58.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
17542024-12-19T06:01:58.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17552024-12-19T06:01:58.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17562024-12-19T06:01:58.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17572024-12-19T06:01:58.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17582024-12-19T06:01:58.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17592024-12-19T06:01:58.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17602024-12-19T06:01:58.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17612024-12-19T06:01:58.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17622024-12-19T06:01:58.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17632024-12-19T06:01:58.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17642024-12-19T06:01:58.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652024-12-19T06:01:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
17662024-12-19T06:01:58.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17672024-12-19T06:01:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17682024-12-19T06:01:58.780ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
17692024-12-19T06:01:58.780ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.697352ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
17702024-12-19T06:01:58.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17712024-12-19T06:01:58.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17722024-12-19T06:01:58.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.509712ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17732024-12-19T06:01:59.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f4b3559-be63-47a5-8a87-ec487c77037c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17742024-12-19T06:01:59.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f4b3559-be63-47a5-8a87-ec487c77037c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17752024-12-19T06:01:59.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f4b3559-be63-47a5-8a87-ec487c77037c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17762024-12-19T06:01:59.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 335ab5e4-5263-4e79-bfa5-354a1a2f599c roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
17772024-12-19T06:01:59.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 335ab5e4-5263-4e79-bfa5-354a1a2f599c resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
17782024-12-19T06:01:59.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 335ab5e4-5263-4e79-bfa5-354a1a2f599c response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
17792024-12-19T06:01:59.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = f687ee6e-81ab-40fb-954b-fad4118bedb4 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
17802024-12-19T06:01:59.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = f687ee6e-81ab-40fb-954b-fad4118bedb4 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
17812024-12-19T06:01:59.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = f687ee6e-81ab-40fb-954b-fad4118bedb4 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
17822024-12-19T06:02:00.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c6b943e5-838b-43fe-bce4-3f0df6938794 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17832024-12-19T06:02:00.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c6b943e5-838b-43fe-bce4-3f0df6938794 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17842024-12-19T06:02:00.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c6b943e5-838b-43fe-bce4-3f0df6938794 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17852024-12-19T06:02:01.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 999b0af1-b5ae-4bc7-a004-6cfe0e516e80 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17862024-12-19T06:02:01.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 999b0af1-b5ae-4bc7-a004-6cfe0e516e80 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17872024-12-19T06:02:01.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 999b0af1-b5ae-4bc7-a004-6cfe0e516e80 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17882024-12-19T06:02:02.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5db0afed-86b3-4de4-86e2-b5bc2dc5cccc roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17892024-12-19T06:02:02.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5db0afed-86b3-4de4-86e2-b5bc2dc5cccc resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17902024-12-19T06:02:02.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5db0afed-86b3-4de4-86e2-b5bc2dc5cccc response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17912024-12-19T06:02:03.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1291669-575c-4519-90a2-f17c6e85df66 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17922024-12-19T06:02:03.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1291669-575c-4519-90a2-f17c6e85df66 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17932024-12-19T06:02:03.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1291669-575c-4519-90a2-f17c6e85df66 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17942024-12-19T06:02:04.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1cb6ab3c-4942-4f40-a59d-b7bbac6c8189 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17952024-12-19T06:02:04.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1cb6ab3c-4942-4f40-a59d-b7bbac6c8189 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17962024-12-19T06:02:04.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1cb6ab3c-4942-4f40-a59d-b7bbac6c8189 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17972024-12-19T06:02:04.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 286f97a2-0590-422d-b600-e6666374b1df response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
17982024-12-19T06:02:05.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 72ee242c-9a09-439e-8b58-0b29a0044d0e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
17992024-12-19T06:02:05.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 72ee242c-9a09-439e-8b58-0b29a0044d0e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18002024-12-19T06:02:05.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 72ee242c-9a09-439e-8b58-0b29a0044d0e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18012024-12-19T06:02:06.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8bcf65b9-b1f0-4649-9204-6269e5c99323 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18022024-12-19T06:02:06.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8bcf65b9-b1f0-4649-9204-6269e5c99323 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18032024-12-19T06:02:06.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8bcf65b9-b1f0-4649-9204-6269e5c99323 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18042024-12-19T06:02:07.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f0679a54-073c-4c77-b385-62ca46b65e0f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18052024-12-19T06:02:07.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f0679a54-073c-4c77-b385-62ca46b65e0f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18062024-12-19T06:02:07.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f0679a54-073c-4c77-b385-62ca46b65e0f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18072024-12-19T06:02:08.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4095bdfa-b57f-4245-8b3a-bed80b54b117 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18082024-12-19T06:02:08.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4095bdfa-b57f-4245-8b3a-bed80b54b117 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18092024-12-19T06:02:08.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4095bdfa-b57f-4245-8b3a-bed80b54b117 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
18102024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
18112024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
18122024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18132024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18142024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
18152024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18162024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
18172024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18182024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
18192024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
18202024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18212024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18222024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
18232024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18242024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
18252024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18262024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
18272024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18282024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
18292024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18302024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18312024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
18322024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
18332024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
18342024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18352024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18362024-12-19T06:02:08.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18372024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
18382024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18392024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
18402024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
18412024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18422024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18432024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
18442024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18452024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18462024-12-19T06:02:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18472024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18482024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18492024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18502024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18512024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18522024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18532024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18542024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18552024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18562024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18572024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18582024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18592024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18602024-12-19T06:02:08.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18612024-12-19T06:02:08.766ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 481401709 } })
18622024-12-19T06:02:08.766ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18632024-12-19T06:02:08.766ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.925877ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18642024-12-19T06:02:08.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18652024-12-19T06:02:08.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18662024-12-19T06:02:08.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18672024-12-19T06:02:08.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18682024-12-19T06:02:08.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 489932254 } })
18692024-12-19T06:02:08.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18702024-12-19T06:02:08.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18712024-12-19T06:02:08.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18722024-12-19T06:02:08.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732024-12-19T06:02:08.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.425578ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
18742024-12-19T06:02:08.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18752024-12-19T06:02:08.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18762024-12-19T06:02:08.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18772024-12-19T06:02:08.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18782024-12-19T06:02:08.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18792024-12-19T06:02:08.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18802024-12-19T06:02:08.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.133457ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
18812024-12-19T06:02:08.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 521067207 } })
18822024-12-19T06:02:08.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18832024-12-19T06:02:08.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
18842024-12-19T06:02:08.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18852024-12-19T06:02:08.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18862024-12-19T06:02:08.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18872024-12-19T06:02:08.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18882024-12-19T06:02:08.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18892024-12-19T06:02:08.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18902024-12-19T06:02:08.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18912024-12-19T06:02:08.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18922024-12-19T06:02:08.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.033455ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18932024-12-19T06:02:08.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18942024-12-19T06:02:08.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18952024-12-19T06:02:08.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18962024-12-19T06:02:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18972024-12-19T06:02:08.811ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18982024-12-19T06:02:08.811ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18992024-12-19T06:02:08.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19002024-12-19T06:02:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19012024-12-19T06:02:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19022024-12-19T06:02:08.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19032024-12-19T06:02:08.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19042024-12-19T06:02:08.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19052024-12-19T06:02:08.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19062024-12-19T06:02:08.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19072024-12-19T06:02:08.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19082024-12-19T06:02:08.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19092024-12-19T06:02:08.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.360486ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19102024-12-19T06:02:08.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
19112024-12-19T06:02:08.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19122024-12-19T06:02:08.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19132024-12-19T06:02:08.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19142024-12-19T06:02:08.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19152024-12-19T06:02:08.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19162024-12-19T06:02:08.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172024-12-19T06:02:08.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19182024-12-19T06:02:08.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19192024-12-19T06:02:08.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19202024-12-19T06:02:08.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19212024-12-19T06:02:08.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19222024-12-19T06:02:08.822ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19232024-12-19T06:02:08.822ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.570639ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19242024-12-19T06:02:08.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19252024-12-19T06:02:08.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19262024-12-19T06:02:08.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19272024-12-19T06:02:08.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19282024-12-19T06:02:08.830ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
19292024-12-19T06:02:08.830ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.349122ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
19302024-12-19T06:02:08.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19312024-12-19T06:02:08.835ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19322024-12-19T06:02:08.835ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12f3c522-5222-4a2a-ab4d-5df1d9820895", "content-length": "26", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
19332024-12-19T06:02:08.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19342024-12-19T06:02:08.837ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19352024-12-19T06:02:08.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19362024-12-19T06:02:08.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19372024-12-19T06:02:08.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19382024-12-19T06:02:08.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19392024-12-19T06:02:08.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.400182ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19402024-12-19T06:02:08.854ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19412024-12-19T06:02:08.854ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19422024-12-19T06:02:08.854ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fbeadfa-c1ec-41b9-818c-774849d34e5b", "content-length": "26", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
19432024-12-19T06:02:08.854ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19442024-12-19T06:02:08.854ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19452024-12-19T06:02:08.854ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19462024-12-19T06:02:08.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19472024-12-19T06:02:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19482024-12-19T06:02:08.856ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19492024-12-19T06:02:08.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19502024-12-19T06:02:08.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19512024-12-19T06:02:08.901ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
19522024-12-19T06:02:08.901ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19532024-12-19T06:02:08.901ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "627cba03-f327-4cb1-a734-04e253cd4316", "content-length": "26", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
19542024-12-19T06:02:08.901ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19552024-12-19T06:02:08.903ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
19562024-12-19T06:02:08.931ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19572024-12-19T06:02:08.931ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19582024-12-19T06:02:08.931ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "32d32329-da23-4713-9d99-4927c1dc91ca", "content-length": "372", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
19592024-12-19T06:02:08.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19602024-12-19T06:02:08.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19612024-12-19T06:02:08.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19622024-12-19T06:02:08.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19632024-12-19T06:02:08.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19642024-12-19T06:02:08.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
19652024-12-19T06:02:08.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19662024-12-19T06:02:08.939ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19672024-12-19T06:02:08.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19682024-12-19T06:02:08.939ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8358b0cb-cd59-46c9-9e2c-89cadf95cae2", "content-length": "1", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
19692024-12-19T06:02:08.940ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 177.893951ms iteration = 18 status = 0
19702024-12-19T06:02:08.940ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19712024-12-19T06:02:08.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19722024-12-19T06:02:08.942ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.318059ms iteration = 18 status = null
19732024-12-19T06:02:08.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 200.18052ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19742024-12-19T06:02:08.974ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19752024-12-19T06:02:08.974ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19762024-12-19T06:02:08.974ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 211.841865ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19772024-12-19T06:02:08.979ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19782024-12-19T06:02:08.979ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19792024-12-19T06:02:08.979ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3bea9d9d-1b8d-43b2-818e-e6ddba3ea475", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
19802024-12-19T06:02:08.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19812024-12-19T06:02:08.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19822024-12-19T06:02:08.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19832024-12-19T06:02:08.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19842024-12-19T06:02:08.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19852024-12-19T06:02:08.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19862024-12-19T06:02:08.988ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19872024-12-19T06:02:08.988ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19882024-12-19T06:02:08.988ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 225.886147ms iteration = 18 status = {}
19892024-12-19T06:02:08.988ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d32c9fb-48dc-4c72-9c16-da015c71a825", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
19902024-12-19T06:02:08.990ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 227.659744ms iteration = 18 status = {}
19912024-12-19T06:02:09.027ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 264.746499ms iteration = 20 status = {"physical_disks_added":0}
19922024-12-19T06:02:09.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19932024-12-19T06:02:09.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19942024-12-19T06:02:09.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19952024-12-19T06:02:09.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19962024-12-19T06:02:09.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19972024-12-19T06:02:09.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19982024-12-19T06:02:09.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992024-12-19T06:02:09.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20002024-12-19T06:02:09.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20012024-12-19T06:02:09.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20022024-12-19T06:02:09.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20032024-12-19T06:02:09.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20042024-12-19T06:02:09.070ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
20052024-12-19T06:02:09.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20062024-12-19T06:02:09.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20072024-12-19T06:02:09.080ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20082024-12-19T06:02:09.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebab8278-3e66-48d0-bb74-5c1b6341f4e4", "content-length": "134", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
20092024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20102024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
20112024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20122024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20132024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20142024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20152024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20162024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20172024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20182024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20192024-12-19T06:02:09.081ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
20202024-12-19T06:02:09.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20212024-12-19T06:02:09.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20222024-12-19T06:02:09.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20232024-12-19T06:02:09.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "13c1bc96-79e0-4c09-a2b3-64a4624aa65b", "content-length": "2", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
20242024-12-19T06:02:09.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20252024-12-19T06:02:09.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "35c4d72e-30e4-4225-9d4f-21b10f8fd25d", "content-length": "52", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
20262024-12-19T06:02:09.084ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
20272024-12-19T06:02:09.084ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20282024-12-19T06:02:09.125ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20292024-12-19T06:02:09.188ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6d763b0c-c545-41de-a00f-b42cea1aee17", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
20302024-12-19T06:02:09.188ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
20312024-12-19T06:02:09.188ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20322024-12-19T06:02:09.189ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7916384d-be83-4b74-8179-c8d52a4717f8", "content-length": "691", "date": "Thu, 19 Dec 2024 06:02:08 GMT"} })
20332024-12-19T06:02:09.189ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20342024-12-19T06:02:09.189ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20352024-12-19T06:02:09.189ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20362024-12-19T06:02:09.189ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "43eea9c4-11e8-4df9-a945-de2f9e76405c", "content-length": "682", "date": "Thu, 19 Dec 2024 06:02:09 GMT"} })
20372024-12-19T06:02:09.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20382024-12-19T06:02:09.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20392024-12-19T06:02:09.191ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 428.98331ms iteration = 18 status = {}
20402024-12-19T06:02:09.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20412024-12-19T06:02:09.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20422024-12-19T06:02:09.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20432024-12-19T06:02:09.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20442024-12-19T06:02:09.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20452024-12-19T06:02:09.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20462024-12-19T06:02:09.207ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 444.349855ms iteration = 18 status = {}
20472024-12-19T06:02:09.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e944eb4e-d36a-49b4-baf5-83c2b5d7b632 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20482024-12-19T06:02:09.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e944eb4e-d36a-49b4-baf5-83c2b5d7b632 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20492024-12-19T06:02:09.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e944eb4e-d36a-49b4-baf5-83c2b5d7b632 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20502024-12-19T06:02:09.527ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20512024-12-19T06:02:09.527ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
20522024-12-19T06:02:09.569ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
20532024-12-19T06:02:09.569ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:35913
20542024-12-19T06:02:09.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35913 req_id = 3761e3a1-a0ed-452f-95d1-d6238e08e216 roles = RoleSet { roles: {} } uri = /metrics/producers
20552024-12-19T06:02:09.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35913 req_id = 3761e3a1-a0ed-452f-95d1-d6238e08e216 resource = Database result = Ok(()) uri = /metrics/producers
20562024-12-19T06:02:09.623ZINFOnexus: assigned collector to new producer collector_id = bf630637-78f3-4e20-a86d-c4f19712ebb4 file = nexus/src/app/oximeter.rs:76 producer_id = 1e0292d6-c327-472e-85e6-622aab78d10f
20572024-12-19T06:02:09.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53400 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35913 req_id = 3761e3a1-a0ed-452f-95d1-d6238e08e216 response_code = 201 uri = /metrics/producers
20582024-12-19T06:02:09.623ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3761e3a1-a0ed-452f-95d1-d6238e08e216", "content-length": "41", "date": "Thu, 19 Dec 2024 06:02:09 GMT"} })
20592024-12-19T06:02:09.626ZDEBGnexus (producer-registration-task): registered with nexus successfully
20602024-12-19T06:02:09.626ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
20612024-12-19T06:02:10.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2d80a0f6-5874-4ff4-af87-7227d24a24fe roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20622024-12-19T06:02:10.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2d80a0f6-5874-4ff4-af87-7227d24a24fe resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20632024-12-19T06:02:10.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2d80a0f6-5874-4ff4-af87-7227d24a24fe response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20642024-12-19T06:02:11.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 331d0729-6522-4000-9297-1c1105521498 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20652024-12-19T06:02:11.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 331d0729-6522-4000-9297-1c1105521498 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20662024-12-19T06:02:11.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 331d0729-6522-4000-9297-1c1105521498 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20672024-12-19T06:02:12.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 52674ec1-d84b-4df4-979f-5683a777aa91 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20682024-12-19T06:02:12.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 52674ec1-d84b-4df4-979f-5683a777aa91 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20692024-12-19T06:02:12.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 52674ec1-d84b-4df4-979f-5683a777aa91 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20702024-12-19T06:02:13.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6ba5840-b7c5-4489-aa6d-e0f94d522d67 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20712024-12-19T06:02:13.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6ba5840-b7c5-4489-aa6d-e0f94d522d67 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20722024-12-19T06:02:13.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6ba5840-b7c5-4489-aa6d-e0f94d522d67 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20732024-12-19T06:02:14.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0d9207f5-19a2-4e87-8c1d-ae07954fb54e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20742024-12-19T06:02:14.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0d9207f5-19a2-4e87-8c1d-ae07954fb54e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20752024-12-19T06:02:14.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0d9207f5-19a2-4e87-8c1d-ae07954fb54e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20762024-12-19T06:02:14.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 62830014-f0b8-4fe3-9134-75a839518ada response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
20772024-12-19T06:02:15.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e33185b-4ef6-471b-b96b-b78c043cc0a1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20782024-12-19T06:02:15.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e33185b-4ef6-471b-b96b-b78c043cc0a1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20792024-12-19T06:02:15.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e33185b-4ef6-471b-b96b-b78c043cc0a1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20802024-12-19T06:02:16.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2dd80b86-fa14-49ea-918b-de04a8f056b1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20812024-12-19T06:02:16.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2dd80b86-fa14-49ea-918b-de04a8f056b1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20822024-12-19T06:02:16.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2dd80b86-fa14-49ea-918b-de04a8f056b1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20832024-12-19T06:02:17.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1c52ae5e-14df-4c68-bbf4-c452be65680f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20842024-12-19T06:02:17.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1c52ae5e-14df-4c68-bbf4-c452be65680f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20852024-12-19T06:02:17.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1c52ae5e-14df-4c68-bbf4-c452be65680f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20862024-12-19T06:02:18.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 557f8622-ecbe-4a16-9c40-04f95077b8b8 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20872024-12-19T06:02:18.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 557f8622-ecbe-4a16-9c40-04f95077b8b8 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20882024-12-19T06:02:18.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 557f8622-ecbe-4a16-9c40-04f95077b8b8 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
20892024-12-19T06:02:18.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
20902024-12-19T06:02:18.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
20912024-12-19T06:02:18.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20922024-12-19T06:02:18.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20932024-12-19T06:02:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20942024-12-19T06:02:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20952024-12-19T06:02:18.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20962024-12-19T06:02:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20972024-12-19T06:02:18.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20982024-12-19T06:02:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20992024-12-19T06:02:18.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21002024-12-19T06:02:18.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21012024-12-19T06:02:18.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21022024-12-19T06:02:18.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
21032024-12-19T06:02:18.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21042024-12-19T06:02:18.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21052024-12-19T06:02:18.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
21062024-12-19T06:02:18.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.48494ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
21072024-12-19T06:02:18.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21082024-12-19T06:02:18.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21092024-12-19T06:02:18.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.39029ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21102024-12-19T06:02:19.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4735bbec-cfaa-4d99-a738-f6b170e8918c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21112024-12-19T06:02:19.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4735bbec-cfaa-4d99-a738-f6b170e8918c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21122024-12-19T06:02:19.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4735bbec-cfaa-4d99-a738-f6b170e8918c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21132024-12-19T06:02:20.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6657fa1c-c345-4781-ac75-76710064a826 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21142024-12-19T06:02:20.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6657fa1c-c345-4781-ac75-76710064a826 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21152024-12-19T06:02:20.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6657fa1c-c345-4781-ac75-76710064a826 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21162024-12-19T06:02:21.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 70b5d878-7f16-41fc-bc0d-e918c6443514 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21172024-12-19T06:02:21.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 70b5d878-7f16-41fc-bc0d-e918c6443514 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21182024-12-19T06:02:21.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 70b5d878-7f16-41fc-bc0d-e918c6443514 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21192024-12-19T06:02:22.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7e8eb441-5fe0-4012-bb8e-cd2fec8a69ac roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21202024-12-19T06:02:22.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7e8eb441-5fe0-4012-bb8e-cd2fec8a69ac resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21212024-12-19T06:02:22.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7e8eb441-5fe0-4012-bb8e-cd2fec8a69ac response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21222024-12-19T06:02:23.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 76e1e15c-2003-44de-9832-43058627a669 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21232024-12-19T06:02:23.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 76e1e15c-2003-44de-9832-43058627a669 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21242024-12-19T06:02:23.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 76e1e15c-2003-44de-9832-43058627a669 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21252024-12-19T06:02:24.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 125bc8bb-3212-4269-b09c-0a77eeffd894 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21262024-12-19T06:02:24.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 125bc8bb-3212-4269-b09c-0a77eeffd894 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21272024-12-19T06:02:24.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 125bc8bb-3212-4269-b09c-0a77eeffd894 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21282024-12-19T06:02:24.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 447 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = ac623183-4e97-462d-819c-669165273200 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
21292024-12-19T06:02:25.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 30af64a2-41f1-4570-9c7a-cb963e758a91 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21302024-12-19T06:02:25.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 30af64a2-41f1-4570-9c7a-cb963e758a91 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21312024-12-19T06:02:25.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 30af64a2-41f1-4570-9c7a-cb963e758a91 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21322024-12-19T06:02:26.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 70d048d1-5596-409b-9df1-daeb9ec8b3d5 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21332024-12-19T06:02:26.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 70d048d1-5596-409b-9df1-daeb9ec8b3d5 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21342024-12-19T06:02:26.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 70d048d1-5596-409b-9df1-daeb9ec8b3d5 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21352024-12-19T06:02:27.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 456c7a83-5652-4987-b5a6-13570bd0a4f6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21362024-12-19T06:02:27.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 456c7a83-5652-4987-b5a6-13570bd0a4f6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21372024-12-19T06:02:27.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 456c7a83-5652-4987-b5a6-13570bd0a4f6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21382024-12-19T06:02:28.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
21392024-12-19T06:02:28.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21402024-12-19T06:02:28.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
21412024-12-19T06:02:28.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21422024-12-19T06:02:28.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21432024-12-19T06:02:28.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21442024-12-19T06:02:28.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452024-12-19T06:02:28.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21462024-12-19T06:02:28.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21472024-12-19T06:02:28.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21482024-12-19T06:02:28.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21492024-12-19T06:02:28.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21502024-12-19T06:02:28.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21512024-12-19T06:02:28.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21522024-12-19T06:02:28.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21532024-12-19T06:02:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
21542024-12-19T06:02:28.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21552024-12-19T06:02:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21562024-12-19T06:02:28.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
21572024-12-19T06:02:28.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.66612ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
21582024-12-19T06:02:28.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.36988ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21592024-12-19T06:02:28.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e5ab8c9-018f-4c9d-909b-a3f566920404 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21602024-12-19T06:02:28.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e5ab8c9-018f-4c9d-909b-a3f566920404 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21612024-12-19T06:02:28.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3e5ab8c9-018f-4c9d-909b-a3f566920404 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21622024-12-19T06:02:29.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = afa1e5ea-4de2-4622-9cfb-9f4a9a7123d0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21632024-12-19T06:02:29.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = afa1e5ea-4de2-4622-9cfb-9f4a9a7123d0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21642024-12-19T06:02:29.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = afa1e5ea-4de2-4622-9cfb-9f4a9a7123d0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21652024-12-19T06:02:31.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e22be553-c22f-4cfa-aa9a-76b5a91180c4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21662024-12-19T06:02:31.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e22be553-c22f-4cfa-aa9a-76b5a91180c4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21672024-12-19T06:02:31.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e22be553-c22f-4cfa-aa9a-76b5a91180c4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21682024-12-19T06:02:32.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1b8e779-8283-47e6-a8c7-773d6218fc0b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21692024-12-19T06:02:32.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1b8e779-8283-47e6-a8c7-773d6218fc0b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21702024-12-19T06:02:32.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f1b8e779-8283-47e6-a8c7-773d6218fc0b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21712024-12-19T06:02:33.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6f6cded3-2878-42b1-b115-2ced3835f616 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21722024-12-19T06:02:33.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6f6cded3-2878-42b1-b115-2ced3835f616 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21732024-12-19T06:02:33.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6f6cded3-2878-42b1-b115-2ced3835f616 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21742024-12-19T06:02:34.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 15d9491f-ec38-477a-be98-5916d49f8cad roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21752024-12-19T06:02:34.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 15d9491f-ec38-477a-be98-5916d49f8cad resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21762024-12-19T06:02:34.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 15d9491f-ec38-477a-be98-5916d49f8cad response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21772024-12-19T06:02:34.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 456 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 14b12393-d927-4165-97eb-54e6ca3a0f61 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
21782024-12-19T06:02:35.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8eb122f-e4bd-4955-94d9-2acc348c8748 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21792024-12-19T06:02:35.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8eb122f-e4bd-4955-94d9-2acc348c8748 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21802024-12-19T06:02:35.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8eb122f-e4bd-4955-94d9-2acc348c8748 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21812024-12-19T06:02:36.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ce7b367a-bd05-4f7d-84ca-dc869e73c5ca roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21822024-12-19T06:02:36.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ce7b367a-bd05-4f7d-84ca-dc869e73c5ca resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21832024-12-19T06:02:36.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ce7b367a-bd05-4f7d-84ca-dc869e73c5ca response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21842024-12-19T06:02:37.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 851a8328-c6c3-42ae-bdee-e1d38c220934 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21852024-12-19T06:02:37.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 851a8328-c6c3-42ae-bdee-e1d38c220934 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21862024-12-19T06:02:37.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 851a8328-c6c3-42ae-bdee-e1d38c220934 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21872024-12-19T06:02:38.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 65f2fa3f-e8a1-4416-a7c8-d3d18dddac46 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21882024-12-19T06:02:38.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 65f2fa3f-e8a1-4416-a7c8-d3d18dddac46 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21892024-12-19T06:02:38.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 65f2fa3f-e8a1-4416-a7c8-d3d18dddac46 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
21902024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
21912024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21922024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
21932024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
21942024-12-19T06:02:38.762ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21952024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21962024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21972024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
21982024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
21992024-12-19T06:02:38.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22002024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22012024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
22022024-12-19T06:02:38.762ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 05:52:38.762511644 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22032024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
22042024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22052024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22062024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22072024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
22082024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22092024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
22102024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22112024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
22122024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
22132024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22142024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
22152024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22162024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
22172024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22182024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
22192024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
22202024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22212024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
22222024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22232024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
22242024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
22252024-12-19T06:02:38.762ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ec4c486a-8de5-4892-b4b1-13175064de2e
22262024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.21\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e"}
22272024-12-19T06:02:38.762ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
22282024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
22292024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22302024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22312024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
22322024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22332024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22342024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
22352024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
22362024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22372024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22382024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
22392024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
22402024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22412024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
22422024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
22432024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22442024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22452024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
22462024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
22472024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22482024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
22492024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22502024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22512024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22522024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
22532024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22542024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22552024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22562024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22572024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22582024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22592024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22602024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22612024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22622024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22632024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22642024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22652024-12-19T06:02:38.763ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("75a56219-191b-4e5c-8eb1-d0e62e0c42f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 478970240 } })
22662024-12-19T06:02:38.763ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ecedc0eb-6c7d-4958-9fee-747c67187e55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 478988731 } })
22672024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22682024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22692024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22702024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22712024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22722024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22732024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22742024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22752024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22762024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22772024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22782024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22792024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22802024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22812024-12-19T06:02:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22822024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22832024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22842024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22852024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22862024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22872024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.464167ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22882024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22892024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22902024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
22912024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.576381ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
22922024-12-19T06:02:38.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22932024-12-19T06:02:38.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22942024-12-19T06:02:38.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22952024-12-19T06:02:38.766ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-12-19T06:02:38.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22972024-12-19T06:02:38.766ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.965168ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22982024-12-19T06:02:38.768ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.455266ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
22992024-12-19T06:02:38.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 483681152 } })
23002024-12-19T06:02:38.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23012024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23022024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23032024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23042024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23052024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23062024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23072024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23082024-12-19T06:02:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23092024-12-19T06:02:38.771ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 05:52:38.762511644 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23102024-12-19T06:02:38.771ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.357062ms iteration = 10 status = {"expiration":"2024-12-19T05:52:38.762511644Z","pruned":[]}
23112024-12-19T06:02:38.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23122024-12-19T06:02:38.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23132024-12-19T06:02:38.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23142024-12-19T06:02:38.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23152024-12-19T06:02:38.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23162024-12-19T06:02:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23172024-12-19T06:02:38.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23182024-12-19T06:02:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23192024-12-19T06:02:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23202024-12-19T06:02:38.774ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23212024-12-19T06:02:38.774ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23222024-12-19T06:02:38.774ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.828532ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23232024-12-19T06:02:38.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23242024-12-19T06:02:38.775ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23252024-12-19T06:02:38.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23262024-12-19T06:02:38.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23272024-12-19T06:02:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23282024-12-19T06:02:38.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23292024-12-19T06:02:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23302024-12-19T06:02:38.779ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23312024-12-19T06:02:38.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 494675596 } })
23322024-12-19T06:02:38.779ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23332024-12-19T06:02:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23342024-12-19T06:02:38.781ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23352024-12-19T06:02:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23362024-12-19T06:02:38.781ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23372024-12-19T06:02:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23382024-12-19T06:02:38.783ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23392024-12-19T06:02:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23402024-12-19T06:02:38.784ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23412024-12-19T06:02:38.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 23.368442ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23422024-12-19T06:02:38.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23432024-12-19T06:02:38.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23442024-12-19T06:02:38.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23452024-12-19T06:02:38.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23462024-12-19T06:02:38.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23472024-12-19T06:02:38.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23482024-12-19T06:02:38.790ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23492024-12-19T06:02:38.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23502024-12-19T06:02:38.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512024-12-19T06:02:38.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23522024-12-19T06:02:38.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23532024-12-19T06:02:38.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23542024-12-19T06:02:38.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23552024-12-19T06:02:38.795ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 510632611 } })
23562024-12-19T06:02:38.795ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
23572024-12-19T06:02:38.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23582024-12-19T06:02:38.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23592024-12-19T06:02:38.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 39.864694ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23602024-12-19T06:02:38.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23612024-12-19T06:02:38.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23622024-12-19T06:02:38.803ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23632024-12-19T06:02:38.803ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23642024-12-19T06:02:38.803ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23652024-12-19T06:02:38.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23662024-12-19T06:02:38.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23672024-12-19T06:02:38.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23682024-12-19T06:02:38.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23692024-12-19T06:02:38.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23702024-12-19T06:02:38.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23712024-12-19T06:02:38.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23722024-12-19T06:02:38.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23732024-12-19T06:02:38.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.549659ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
23742024-12-19T06:02:38.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23752024-12-19T06:02:38.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23762024-12-19T06:02:38.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23772024-12-19T06:02:38.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23782024-12-19T06:02:38.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23792024-12-19T06:02:38.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23802024-12-19T06:02:38.813ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23812024-12-19T06:02:38.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23822024-12-19T06:02:38.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23832024-12-19T06:02:38.814ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23842024-12-19T06:02:38.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23852024-12-19T06:02:38.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23862024-12-19T06:02:38.816ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23872024-12-19T06:02:38.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.510744ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23882024-12-19T06:02:38.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23892024-12-19T06:02:38.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23902024-12-19T06:02:38.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23912024-12-19T06:02:38.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23922024-12-19T06:02:38.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.697065ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
23932024-12-19T06:02:38.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23942024-12-19T06:02:38.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23952024-12-19T06:02:38.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23962024-12-19T06:02:38.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23972024-12-19T06:02:38.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23982024-12-19T06:02:38.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23992024-12-19T06:02:38.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24002024-12-19T06:02:38.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24012024-12-19T06:02:38.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24022024-12-19T06:02:38.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24032024-12-19T06:02:38.823ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 60.593512ms iteration = 5 status = {"nsuccess":5}
24042024-12-19T06:02:38.823ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24052024-12-19T06:02:38.823ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24062024-12-19T06:02:38.823ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 60.920803ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24072024-12-19T06:02:38.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24082024-12-19T06:02:38.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24092024-12-19T06:02:38.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24102024-12-19T06:02:38.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24112024-12-19T06:02:38.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24122024-12-19T06:02:38.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24132024-12-19T06:02:38.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24142024-12-19T06:02:38.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24152024-12-19T06:02:38.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24162024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24172024-12-19T06:02:38.830ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24182024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24192024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24202024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24212024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24222024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24232024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24242024-12-19T06:02:38.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24252024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
24262024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24272024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24282024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24292024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24302024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24312024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24322024-12-19T06:02:38.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24332024-12-19T06:02:38.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24342024-12-19T06:02:38.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24352024-12-19T06:02:38.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24362024-12-19T06:02:38.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24372024-12-19T06:02:38.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.789931ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24382024-12-19T06:02:38.844ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24392024-12-19T06:02:38.844ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.498246ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24402024-12-19T06:02:38.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
24412024-12-19T06:02:38.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.855499ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
24422024-12-19T06:02:38.849ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24432024-12-19T06:02:38.849ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 0 version = 2
24442024-12-19T06:02:38.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24452024-12-19T06:02:38.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24462024-12-19T06:02:38.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24472024-12-19T06:02:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24482024-12-19T06:02:38.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24492024-12-19T06:02:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24502024-12-19T06:02:38.855ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 1 version = 2
24512024-12-19T06:02:38.855ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24522024-12-19T06:02:38.855ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 05:54:07.672295 UTC dns_group = external generation = 2
24532024-12-19T06:02:38.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 92.795999ms iteration = 10 status = {"generation":2}
24542024-12-19T06:02:38.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24552024-12-19T06:02:38.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24562024-12-19T06:02:38.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24572024-12-19T06:02:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24582024-12-19T06:02:38.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24592024-12-19T06:02:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24602024-12-19T06:02:38.862ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T05:53:28.550897Z, time_modified: 2024-12-19T05:53:28.550897Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }) }
24612024-12-19T06:02:38.862ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 99.387091ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]}},"default_endpoint":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24622024-12-19T06:02:38.872ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24632024-12-19T06:02:38.872ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24642024-12-19T06:02:38.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24652024-12-19T06:02:38.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24662024-12-19T06:02:38.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24672024-12-19T06:02:38.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24682024-12-19T06:02:38.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24692024-12-19T06:02:38.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24702024-12-19T06:02:38.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712024-12-19T06:02:38.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24722024-12-19T06:02:38.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24732024-12-19T06:02:38.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24742024-12-19T06:02:38.886ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24752024-12-19T06:02:38.888ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24762024-12-19T06:02:38.888ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24772024-12-19T06:02:38.888ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 05:54:06.714960 UTC dns_group = internal generation = 1
24782024-12-19T06:02:38.888ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 126.216766ms iteration = 10 status = {"generation":1}
24792024-12-19T06:02:38.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24802024-12-19T06:02:38.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24812024-12-19T06:02:38.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24822024-12-19T06:02:38.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
24832024-12-19T06:02:38.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24842024-12-19T06:02:38.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24852024-12-19T06:02:38.901ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 138.711289ms iteration = 19 status = 0
24862024-12-19T06:02:38.901ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24872024-12-19T06:02:38.905ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24882024-12-19T06:02:38.905ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24892024-12-19T06:02:38.905ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.168429ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24902024-12-19T06:02:38.922ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.357794ms iteration = 21 status = {"physical_disks_added":0}
24912024-12-19T06:02:38.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24922024-12-19T06:02:38.928ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24932024-12-19T06:02:38.928ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8899cc52-51e4-4e59-bc37-c8c6b1a4face", "content-length": "26", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
24942024-12-19T06:02:38.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24952024-12-19T06:02:38.931ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24962024-12-19T06:02:38.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24972024-12-19T06:02:38.942ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24982024-12-19T06:02:38.942ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9ac42a8-68c1-40d5-92aa-c9918f001ef1", "content-length": "26", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
24992024-12-19T06:02:38.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25002024-12-19T06:02:38.944ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25012024-12-19T06:02:38.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25022024-12-19T06:02:38.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25032024-12-19T06:02:38.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
25042024-12-19T06:02:38.961ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25052024-12-19T06:02:38.961ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0834e9bf-86d5-4405-9b18-0bab60375b40", "content-length": "26", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25062024-12-19T06:02:38.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25072024-12-19T06:02:38.961ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25082024-12-19T06:02:38.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.812045ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25092024-12-19T06:02:38.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
25102024-12-19T06:02:38.964ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25112024-12-19T06:02:38.964ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25122024-12-19T06:02:38.964ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "76aa1fbf-d3ed-4e9c-8fcf-6ae94be09bee", "content-length": "372", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25132024-12-19T06:02:38.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25142024-12-19T06:02:38.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25152024-12-19T06:02:38.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25162024-12-19T06:02:38.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25172024-12-19T06:02:38.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25182024-12-19T06:02:38.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25192024-12-19T06:02:38.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25202024-12-19T06:02:38.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25212024-12-19T06:02:38.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25222024-12-19T06:02:38.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25232024-12-19T06:02:38.999ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25242024-12-19T06:02:39.017ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
25252024-12-19T06:02:39.017ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25262024-12-19T06:02:39.017ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9a8d306b-bcf1-44dd-bdb2-59ce5daf5bff", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25272024-12-19T06:02:39.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25282024-12-19T06:02:39.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25292024-12-19T06:02:39.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25302024-12-19T06:02:39.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25312024-12-19T06:02:39.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25322024-12-19T06:02:39.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25332024-12-19T06:02:39.026ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25342024-12-19T06:02:39.026ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25352024-12-19T06:02:39.027ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0b0b7060-f77a-43b6-972f-716f7c4d5c20", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25362024-12-19T06:02:39.028ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 265.805733ms iteration = 19 status = {}
25372024-12-19T06:02:39.081ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 318.46667ms iteration = 19 status = {}
25382024-12-19T06:02:39.115ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25392024-12-19T06:02:39.116ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbebd6ff-1bc7-441c-9da5-f1e237e8380d", "content-length": "1", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25402024-12-19T06:02:39.117ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25412024-12-19T06:02:39.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25422024-12-19T06:02:39.121ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25432024-12-19T06:02:39.122ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5aa2beb6-79cd-448a-9dee-104ba181f923", "date": "Thu, 19 Dec 2024 06:02:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25442024-12-19T06:02:39.122ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25452024-12-19T06:02:39.123ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fccd734a-5c60-4427-b8c5-c74ed94404fd", "date": "Thu, 19 Dec 2024 06:02:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25462024-12-19T06:02:39.123ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25472024-12-19T06:02:39.124ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25482024-12-19T06:02:39.124ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 362.490348ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25492024-12-19T06:02:39.131ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25502024-12-19T06:02:39.132ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1857feea-8803-43ad-ace3-e4723a6d913b", "date": "Thu, 19 Dec 2024 06:02:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25512024-12-19T06:02:39.132ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25522024-12-19T06:02:39.136ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f03cb478-5014-4679-8073-f8408ca43698", "date": "Thu, 19 Dec 2024 06:02:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25532024-12-19T06:02:39.136ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25542024-12-19T06:02:39.137ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ef6e1ce1-bce3-4cc6-80a9-cf10e57a9a92", "date": "Thu, 19 Dec 2024 06:02:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25552024-12-19T06:02:39.137ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25562024-12-19T06:02:39.139ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25572024-12-19T06:02:39.139ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 376.866501ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25582024-12-19T06:02:39.163ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25592024-12-19T06:02:39.163ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "960a2a21-76bf-4bce-a9ff-3bffc9adf1c1", "content-length": "691", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25602024-12-19T06:02:39.163ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
25612024-12-19T06:02:39.163ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25622024-12-19T06:02:39.163ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25632024-12-19T06:02:39.164ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 401.873847ms iteration = 19 status = {}
25642024-12-19T06:02:39.165ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 402.480227ms iteration = 19 status = null
25652024-12-19T06:02:39.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 17160f3d-f1b0-4e6d-8f9a-f12255ecca83 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
25662024-12-19T06:02:39.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 17160f3d-f1b0-4e6d-8f9a-f12255ecca83 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
25672024-12-19T06:02:39.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25682024-12-19T06:02:39.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25692024-12-19T06:02:39.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 17160f3d-f1b0-4e6d-8f9a-f12255ecca83 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
25702024-12-19T06:02:39.207ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
25712024-12-19T06:02:39.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25722024-12-19T06:02:39.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25732024-12-19T06:02:39.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25742024-12-19T06:02:39.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1b5a1ba-a27f-4db9-84d1-95c31655fe49", "content-length": "134", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25752024-12-19T06:02:39.216ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25762024-12-19T06:02:39.216ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
25772024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25782024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25792024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25802024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25812024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25822024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25832024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25842024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25852024-12-19T06:02:39.217ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
25862024-12-19T06:02:39.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25872024-12-19T06:02:39.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25882024-12-19T06:02:39.219ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25892024-12-19T06:02:39.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "689c6ee0-b173-4aa6-adfd-1d911d232b2f", "content-length": "2", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25902024-12-19T06:02:39.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25912024-12-19T06:02:39.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8378f80f-5314-4fe6-b87c-23249abcee93", "content-length": "52", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25922024-12-19T06:02:39.220ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
25932024-12-19T06:02:39.220ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25942024-12-19T06:02:39.318ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "378283b2-9bf1-4cd1-937d-471b1b5374eb", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25952024-12-19T06:02:39.318ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
25962024-12-19T06:02:39.318ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25972024-12-19T06:02:39.318ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "47aacde4-ab23-43b9-8986-b6697eba0291", "content-length": "682", "date": "Thu, 19 Dec 2024 06:02:38 GMT"} })
25982024-12-19T06:02:39.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25992024-12-19T06:02:39.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26002024-12-19T06:02:39.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26012024-12-19T06:02:39.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26022024-12-19T06:02:39.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26032024-12-19T06:02:39.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26042024-12-19T06:02:39.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26052024-12-19T06:02:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26062024-12-19T06:02:39.334ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 572.100011ms iteration = 19 status = {}
26072024-12-19T06:02:40.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = da69e646-edc1-4792-b478-ba67f905fcb2 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26082024-12-19T06:02:40.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = da69e646-edc1-4792-b478-ba67f905fcb2 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26092024-12-19T06:02:40.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = da69e646-edc1-4792-b478-ba67f905fcb2 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26102024-12-19T06:02:41.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a50bdb78-382e-4e39-8d3d-df8690236e63 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26112024-12-19T06:02:41.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a50bdb78-382e-4e39-8d3d-df8690236e63 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26122024-12-19T06:02:41.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a50bdb78-382e-4e39-8d3d-df8690236e63 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26132024-12-19T06:02:42.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 717502cb-6a61-481c-b5e0-84281aa703fe roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26142024-12-19T06:02:42.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 717502cb-6a61-481c-b5e0-84281aa703fe resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26152024-12-19T06:02:42.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 717502cb-6a61-481c-b5e0-84281aa703fe response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26162024-12-19T06:02:43.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 96829f33-636b-44a0-afe8-a671c34c4ecc roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26172024-12-19T06:02:43.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 96829f33-636b-44a0-afe8-a671c34c4ecc resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26182024-12-19T06:02:43.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 96829f33-636b-44a0-afe8-a671c34c4ecc response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26192024-12-19T06:02:44.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39382acb-b0a6-4c96-81c6-95ae43ae2669 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26202024-12-19T06:02:44.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39382acb-b0a6-4c96-81c6-95ae43ae2669 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26212024-12-19T06:02:44.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39382acb-b0a6-4c96-81c6-95ae43ae2669 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26222024-12-19T06:02:44.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 434 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = ec496a4b-4c00-4d28-a52c-2e611a0b889d response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
26232024-12-19T06:02:45.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f44fd7d-39ae-40ae-8f6b-37b984e14749 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26242024-12-19T06:02:45.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f44fd7d-39ae-40ae-8f6b-37b984e14749 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26252024-12-19T06:02:45.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7f44fd7d-39ae-40ae-8f6b-37b984e14749 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26262024-12-19T06:02:46.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d24f7020-dc31-41f4-b2d7-a741a3ef38bc roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26272024-12-19T06:02:46.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d24f7020-dc31-41f4-b2d7-a741a3ef38bc resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26282024-12-19T06:02:46.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d24f7020-dc31-41f4-b2d7-a741a3ef38bc response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26292024-12-19T06:02:47.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0d3dab79-c45b-4e57-b725-e97e002f6f73 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26302024-12-19T06:02:47.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0d3dab79-c45b-4e57-b725-e97e002f6f73 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26312024-12-19T06:02:47.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0d3dab79-c45b-4e57-b725-e97e002f6f73 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26322024-12-19T06:02:48.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8c1dd5f5-6d1a-46db-b0ee-87292a5e2740 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26332024-12-19T06:02:48.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8c1dd5f5-6d1a-46db-b0ee-87292a5e2740 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26342024-12-19T06:02:48.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8c1dd5f5-6d1a-46db-b0ee-87292a5e2740 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26352024-12-19T06:02:48.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
26362024-12-19T06:02:48.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
26372024-12-19T06:02:48.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26382024-12-19T06:02:48.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26392024-12-19T06:02:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26402024-12-19T06:02:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26412024-12-19T06:02:48.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26422024-12-19T06:02:48.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26432024-12-19T06:02:48.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442024-12-19T06:02:48.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26452024-12-19T06:02:48.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26462024-12-19T06:02:48.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26472024-12-19T06:02:48.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26482024-12-19T06:02:48.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26492024-12-19T06:02:48.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26502024-12-19T06:02:48.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
26512024-12-19T06:02:48.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26522024-12-19T06:02:48.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26532024-12-19T06:02:48.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
26542024-12-19T06:02:48.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.19271ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
26552024-12-19T06:02:48.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.510765ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26562024-12-19T06:02:49.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6644c2c5-c072-4efa-a1d3-15c8b6cdf2ce roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26572024-12-19T06:02:49.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6644c2c5-c072-4efa-a1d3-15c8b6cdf2ce resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26582024-12-19T06:02:49.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6644c2c5-c072-4efa-a1d3-15c8b6cdf2ce response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26592024-12-19T06:02:50.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 340905cf-275a-4f0c-8363-499519093f40 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26602024-12-19T06:02:50.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 340905cf-275a-4f0c-8363-499519093f40 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26612024-12-19T06:02:50.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 340905cf-275a-4f0c-8363-499519093f40 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26622024-12-19T06:02:51.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cc02e09a-3c2b-4d40-8930-d249b59182cd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26632024-12-19T06:02:51.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cc02e09a-3c2b-4d40-8930-d249b59182cd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26642024-12-19T06:02:51.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cc02e09a-3c2b-4d40-8930-d249b59182cd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26652024-12-19T06:02:52.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7e7e9c52-7994-4039-b701-97088205c9d1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26662024-12-19T06:02:52.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7e7e9c52-7994-4039-b701-97088205c9d1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26672024-12-19T06:02:52.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7e7e9c52-7994-4039-b701-97088205c9d1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26682024-12-19T06:02:53.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5d10b04a-6b24-4b0f-8a82-29b4a40a6e71 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26692024-12-19T06:02:53.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5d10b04a-6b24-4b0f-8a82-29b4a40a6e71 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26702024-12-19T06:02:53.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5d10b04a-6b24-4b0f-8a82-29b4a40a6e71 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26712024-12-19T06:02:54.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6be328d1-ce04-4846-aad4-1e26ca103518 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26722024-12-19T06:02:54.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6be328d1-ce04-4846-aad4-1e26ca103518 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26732024-12-19T06:02:54.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6be328d1-ce04-4846-aad4-1e26ca103518 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26742024-12-19T06:02:54.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 01cbc822-6e5c-487b-843e-aa8c028aa431 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
26752024-12-19T06:02:55.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 375a3eec-d719-41ba-b5ad-2056266bb0b3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26762024-12-19T06:02:55.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 375a3eec-d719-41ba-b5ad-2056266bb0b3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26772024-12-19T06:02:55.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 375a3eec-d719-41ba-b5ad-2056266bb0b3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26782024-12-19T06:02:56.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e13b6fc1-f6b1-41b1-9e6d-ecab08c9bad3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26792024-12-19T06:02:56.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e13b6fc1-f6b1-41b1-9e6d-ecab08c9bad3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26802024-12-19T06:02:56.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e13b6fc1-f6b1-41b1-9e6d-ecab08c9bad3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26812024-12-19T06:02:57.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4825d599-92d2-41e3-96f2-9d17fd34c21a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26822024-12-19T06:02:57.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4825d599-92d2-41e3-96f2-9d17fd34c21a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26832024-12-19T06:02:57.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4825d599-92d2-41e3-96f2-9d17fd34c21a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26842024-12-19T06:02:58.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8d8c242e-5007-4cd1-a175-cf782539a78d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26852024-12-19T06:02:58.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8d8c242e-5007-4cd1-a175-cf782539a78d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26862024-12-19T06:02:58.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8d8c242e-5007-4cd1-a175-cf782539a78d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
26872024-12-19T06:02:58.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
26882024-12-19T06:02:58.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
26892024-12-19T06:02:58.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26902024-12-19T06:02:58.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26912024-12-19T06:02:58.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26922024-12-19T06:02:58.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26932024-12-19T06:02:58.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26942024-12-19T06:02:58.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26952024-12-19T06:02:58.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26962024-12-19T06:02:58.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26972024-12-19T06:02:58.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26982024-12-19T06:02:58.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26992024-12-19T06:02:58.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27002024-12-19T06:02:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
27012024-12-19T06:02:58.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27022024-12-19T06:02:58.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27032024-12-19T06:02:58.781ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
27042024-12-19T06:02:58.781ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.407047ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
27052024-12-19T06:02:58.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27062024-12-19T06:02:58.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27072024-12-19T06:02:58.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.959109ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27082024-12-19T06:02:59.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 63d86a00-3d22-4649-8496-fd606c522787 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27092024-12-19T06:02:59.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 63d86a00-3d22-4649-8496-fd606c522787 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27102024-12-19T06:02:59.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 63d86a00-3d22-4649-8496-fd606c522787 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27112024-12-19T06:03:00.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e758f7d1-61f5-4d5b-8327-a1bf5ad29281 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27122024-12-19T06:03:00.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e758f7d1-61f5-4d5b-8327-a1bf5ad29281 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27132024-12-19T06:03:00.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e758f7d1-61f5-4d5b-8327-a1bf5ad29281 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27142024-12-19T06:03:01.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 979e2cb7-699f-43d8-a1b4-b68a89f27fe3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27152024-12-19T06:03:01.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 979e2cb7-699f-43d8-a1b4-b68a89f27fe3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27162024-12-19T06:03:01.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 979e2cb7-699f-43d8-a1b4-b68a89f27fe3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27172024-12-19T06:03:02.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 695650ea-8b47-4c2a-9b49-d9eeeb1c884e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27182024-12-19T06:03:02.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 695650ea-8b47-4c2a-9b49-d9eeeb1c884e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27192024-12-19T06:03:02.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 695650ea-8b47-4c2a-9b49-d9eeeb1c884e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27202024-12-19T06:03:03.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6b956a2-2645-4b37-a2ee-bf5874ca76bf roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27212024-12-19T06:03:03.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6b956a2-2645-4b37-a2ee-bf5874ca76bf resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27222024-12-19T06:03:03.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6b956a2-2645-4b37-a2ee-bf5874ca76bf response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27232024-12-19T06:03:04.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1fa3fd18-dfd8-4cfe-9375-cd68e85dbb98 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27242024-12-19T06:03:04.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1fa3fd18-dfd8-4cfe-9375-cd68e85dbb98 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27252024-12-19T06:03:04.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1fa3fd18-dfd8-4cfe-9375-cd68e85dbb98 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27262024-12-19T06:03:04.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 421 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = f827f1a1-8ac4-4668-868a-e859b1137508 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
27272024-12-19T06:03:05.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e87b0ae6-1784-4aab-95ee-4da9aa7df2bd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27282024-12-19T06:03:05.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e87b0ae6-1784-4aab-95ee-4da9aa7df2bd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27292024-12-19T06:03:05.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e87b0ae6-1784-4aab-95ee-4da9aa7df2bd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27302024-12-19T06:03:06.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e0929ffc-3a59-47d4-b31e-2cc487fff571 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27312024-12-19T06:03:06.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e0929ffc-3a59-47d4-b31e-2cc487fff571 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27322024-12-19T06:03:06.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e0929ffc-3a59-47d4-b31e-2cc487fff571 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27332024-12-19T06:03:07.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dff73f4d-7d6a-405a-936b-6cdf1f92627d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27342024-12-19T06:03:07.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dff73f4d-7d6a-405a-936b-6cdf1f92627d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27352024-12-19T06:03:07.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dff73f4d-7d6a-405a-936b-6cdf1f92627d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
27362024-12-19T06:03:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
27372024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
27382024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27392024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27402024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
27412024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27422024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
27432024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
27442024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27452024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27462024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
27472024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27482024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
27492024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
27502024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27512024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
27522024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27532024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
27542024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
27552024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27562024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27572024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
27582024-12-19T06:03:08.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27592024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27602024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
27612024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
27622024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27632024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27642024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
27652024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27662024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
27672024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27682024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
27692024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27702024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27712024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27722024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27732024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27742024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27752024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27762024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27772024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27782024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27792024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27802024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27812024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27822024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27832024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27842024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27852024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27862024-12-19T06:03:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27872024-12-19T06:03:08.764ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.860162ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27882024-12-19T06:03:08.764ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 480300773 } })
27892024-12-19T06:03:08.765ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27902024-12-19T06:03:08.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27912024-12-19T06:03:08.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27922024-12-19T06:03:08.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27932024-12-19T06:03:08.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27942024-12-19T06:03:08.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27952024-12-19T06:03:08.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962024-12-19T06:03:08.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27972024-12-19T06:03:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27982024-12-19T06:03:08.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27992024-12-19T06:03:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28002024-12-19T06:03:08.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28012024-12-19T06:03:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28022024-12-19T06:03:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28032024-12-19T06:03:08.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28042024-12-19T06:03:08.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28052024-12-19T06:03:08.770ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 486235905 } })
28062024-12-19T06:03:08.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28072024-12-19T06:03:08.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28082024-12-19T06:03:08.771ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
28092024-12-19T06:03:08.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28102024-12-19T06:03:08.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28112024-12-19T06:03:08.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28122024-12-19T06:03:08.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28132024-12-19T06:03:08.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28142024-12-19T06:03:08.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28152024-12-19T06:03:08.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28162024-12-19T06:03:08.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28172024-12-19T06:03:08.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28182024-12-19T06:03:08.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28192024-12-19T06:03:08.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28202024-12-19T06:03:08.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28212024-12-19T06:03:08.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28222024-12-19T06:03:08.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28232024-12-19T06:03:08.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28242024-12-19T06:03:08.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28252024-12-19T06:03:08.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28262024-12-19T06:03:08.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28272024-12-19T06:03:08.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28282024-12-19T06:03:08.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28292024-12-19T06:03:08.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28302024-12-19T06:03:08.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28312024-12-19T06:03:08.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28322024-12-19T06:03:08.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28332024-12-19T06:03:08.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28342024-12-19T06:03:08.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28352024-12-19T06:03:08.788ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 503633035 } })
28362024-12-19T06:03:08.788ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
28372024-12-19T06:03:08.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28382024-12-19T06:03:08.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28392024-12-19T06:03:08.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28402024-12-19T06:03:08.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28412024-12-19T06:03:08.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
28422024-12-19T06:03:08.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28432024-12-19T06:03:08.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28442024-12-19T06:03:08.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 35.753562ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
28452024-12-19T06:03:08.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
28462024-12-19T06:03:08.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.099114ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
28472024-12-19T06:03:08.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28482024-12-19T06:03:08.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28492024-12-19T06:03:08.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28502024-12-19T06:03:08.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28512024-12-19T06:03:08.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.618585ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28522024-12-19T06:03:08.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28532024-12-19T06:03:08.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28542024-12-19T06:03:08.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28552024-12-19T06:03:08.829ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28562024-12-19T06:03:08.829ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28572024-12-19T06:03:08.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28582024-12-19T06:03:08.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28592024-12-19T06:03:08.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28602024-12-19T06:03:08.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28612024-12-19T06:03:08.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.704598ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28622024-12-19T06:03:08.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
28632024-12-19T06:03:08.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28642024-12-19T06:03:08.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28652024-12-19T06:03:08.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.607949ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
28662024-12-19T06:03:08.836ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.035106ms iteration = 20 status = 0
28672024-12-19T06:03:08.836ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28682024-12-19T06:03:08.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.971196ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28692024-12-19T06:03:08.845ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28702024-12-19T06:03:08.845ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28712024-12-19T06:03:08.845ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ded18523-f883-42c4-918c-e65c2fcecd32", "content-length": "26", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
28722024-12-19T06:03:08.845ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28732024-12-19T06:03:08.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28742024-12-19T06:03:08.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 94.749902ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28752024-12-19T06:03:08.863ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28762024-12-19T06:03:08.863ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28772024-12-19T06:03:08.863ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd3c9fb3-15ff-4202-af53-8fb077fbf3b7", "content-length": "26", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
28782024-12-19T06:03:08.863ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28792024-12-19T06:03:08.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28802024-12-19T06:03:08.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.530372ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28812024-12-19T06:03:08.870ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28822024-12-19T06:03:08.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28832024-12-19T06:03:08.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28842024-12-19T06:03:08.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28852024-12-19T06:03:08.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
28862024-12-19T06:03:08.905ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28872024-12-19T06:03:08.905ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f4d27b4-0d5b-46e3-875f-e115f83b64b9", "content-length": "26", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
28882024-12-19T06:03:08.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28892024-12-19T06:03:08.906ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.267608ms iteration = 22 status = {"physical_disks_added":0}
28902024-12-19T06:03:08.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28912024-12-19T06:03:08.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28922024-12-19T06:03:08.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
28932024-12-19T06:03:08.907ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28942024-12-19T06:03:08.907ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28952024-12-19T06:03:08.907ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.496868ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28962024-12-19T06:03:08.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28972024-12-19T06:03:08.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28982024-12-19T06:03:08.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28992024-12-19T06:03:08.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29002024-12-19T06:03:08.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29012024-12-19T06:03:08.913ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29022024-12-19T06:03:08.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29032024-12-19T06:03:08.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29042024-12-19T06:03:08.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6094e33e-4ceb-45d6-8d9f-1e7feb6e3602 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29052024-12-19T06:03:08.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6094e33e-4ceb-45d6-8d9f-1e7feb6e3602 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29062024-12-19T06:03:08.965ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 203.983382ms iteration = 20 status = {}
29072024-12-19T06:03:08.982ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29082024-12-19T06:03:08.982ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "48422792-c572-4ee7-9b60-375e81554481", "content-length": "1", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29092024-12-19T06:03:08.984ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29102024-12-19T06:03:08.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29112024-12-19T06:03:08.993ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29122024-12-19T06:03:08.993ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29132024-12-19T06:03:08.993ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "855f7969-6e12-4a29-8ba4-201a1f33543c", "content-length": "372", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29142024-12-19T06:03:08.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29152024-12-19T06:03:08.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29162024-12-19T06:03:08.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6094e33e-4ceb-45d6-8d9f-1e7feb6e3602 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29172024-12-19T06:03:08.995ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 233.928416ms iteration = 20 status = null
29182024-12-19T06:03:09.017ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29192024-12-19T06:03:09.017ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b6691f6-bf37-4fd8-88dd-6138be5cfeed", "content-length": "691", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29202024-12-19T06:03:09.017ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29212024-12-19T06:03:09.017ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29222024-12-19T06:03:09.017ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29232024-12-19T06:03:09.019ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 257.136634ms iteration = 20 status = {}
29242024-12-19T06:03:09.037ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
29252024-12-19T06:03:09.037ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29262024-12-19T06:03:09.038ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "97a3a851-4f4c-45d6-ac88-f59a0d42feb8", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29272024-12-19T06:03:09.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29282024-12-19T06:03:09.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29292024-12-19T06:03:09.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29302024-12-19T06:03:09.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29312024-12-19T06:03:09.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29322024-12-19T06:03:09.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29332024-12-19T06:03:09.047ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29342024-12-19T06:03:09.047ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29352024-12-19T06:03:09.048ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7aa87d87-aa06-4f79-a18d-92057d807231", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29362024-12-19T06:03:09.049ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.557984ms iteration = 20 status = {}
29372024-12-19T06:03:09.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29382024-12-19T06:03:09.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29392024-12-19T06:03:09.078ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
29402024-12-19T06:03:09.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29412024-12-19T06:03:09.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29422024-12-19T06:03:09.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29432024-12-19T06:03:09.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b670104-b75a-4af0-af40-a061e787d936", "content-length": "134", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29442024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29452024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
29462024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29472024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29482024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29492024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29502024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29512024-12-19T06:03:09.088ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29522024-12-19T06:03:09.089ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29532024-12-19T06:03:09.089ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29542024-12-19T06:03:09.089ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
29552024-12-19T06:03:09.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29562024-12-19T06:03:09.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29572024-12-19T06:03:09.091ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29582024-12-19T06:03:09.091ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e41a91b2-ac04-4122-b309-b373cfba81fa", "content-length": "2", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29592024-12-19T06:03:09.091ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29602024-12-19T06:03:09.091ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f96829d8-f093-468d-a53e-8c5f7ce42498", "content-length": "52", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29612024-12-19T06:03:09.091ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
29622024-12-19T06:03:09.091ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29632024-12-19T06:03:09.191ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9cd36d6a-6312-433c-9022-366bb105ce18", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29642024-12-19T06:03:09.191ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
29652024-12-19T06:03:09.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29662024-12-19T06:03:09.191ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ba6336b-7681-439d-a4e6-46df674a08af", "content-length": "682", "date": "Thu, 19 Dec 2024 06:03:08 GMT"} })
29672024-12-19T06:03:09.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29682024-12-19T06:03:09.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29692024-12-19T06:03:09.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29702024-12-19T06:03:09.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29712024-12-19T06:03:09.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29722024-12-19T06:03:09.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29732024-12-19T06:03:09.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29742024-12-19T06:03:09.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29752024-12-19T06:03:09.208ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 446.101822ms iteration = 20 status = {}
29762024-12-19T06:03:10.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 501e2223-279d-4302-b5c0-e0a9ecead810 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29772024-12-19T06:03:10.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 501e2223-279d-4302-b5c0-e0a9ecead810 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29782024-12-19T06:03:10.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 501e2223-279d-4302-b5c0-e0a9ecead810 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29792024-12-19T06:03:11.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ee9b24cc-7f9f-4f76-8252-17cb127c1072 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29802024-12-19T06:03:11.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ee9b24cc-7f9f-4f76-8252-17cb127c1072 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29812024-12-19T06:03:11.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ee9b24cc-7f9f-4f76-8252-17cb127c1072 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29822024-12-19T06:03:12.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 433d16a1-0072-4a54-8e53-ea4478771a2c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29832024-12-19T06:03:12.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 433d16a1-0072-4a54-8e53-ea4478771a2c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29842024-12-19T06:03:12.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 433d16a1-0072-4a54-8e53-ea4478771a2c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29852024-12-19T06:03:13.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 53ea42af-bf61-4102-958e-bd192c3dd74c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29862024-12-19T06:03:13.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 53ea42af-bf61-4102-958e-bd192c3dd74c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29872024-12-19T06:03:13.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 53ea42af-bf61-4102-958e-bd192c3dd74c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29882024-12-19T06:03:14.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ce636ec5-736c-438c-8c45-579b82275bc1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29892024-12-19T06:03:14.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ce636ec5-736c-438c-8c45-579b82275bc1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29902024-12-19T06:03:14.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ce636ec5-736c-438c-8c45-579b82275bc1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29912024-12-19T06:03:14.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = d445ea50-89dd-4c2d-8ea5-6a97634260b1 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
29922024-12-19T06:03:14.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = d445ea50-89dd-4c2d-8ea5-6a97634260b1 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
29932024-12-19T06:03:14.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = d445ea50-89dd-4c2d-8ea5-6a97634260b1 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
29942024-12-19T06:03:14.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = e753af49-051e-4c66-9503-93a7959e831c roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
29952024-12-19T06:03:14.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = e753af49-051e-4c66-9503-93a7959e831c resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
29962024-12-19T06:03:14.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = e753af49-051e-4c66-9503-93a7959e831c response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
29972024-12-19T06:03:14.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 431 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 69f3b5fc-a684-424f-aea9-63fb29a9cea6 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
29982024-12-19T06:03:15.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82fb0a2a-3b18-46dd-8633-a93c221f6ef0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
29992024-12-19T06:03:15.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82fb0a2a-3b18-46dd-8633-a93c221f6ef0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30002024-12-19T06:03:15.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82fb0a2a-3b18-46dd-8633-a93c221f6ef0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30012024-12-19T06:03:16.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 450be033-c61c-483d-9bb4-3e5bd068ba07 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30022024-12-19T06:03:16.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 450be033-c61c-483d-9bb4-3e5bd068ba07 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30032024-12-19T06:03:16.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 450be033-c61c-483d-9bb4-3e5bd068ba07 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30042024-12-19T06:03:17.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9fb9df60-ee03-418a-849b-c6a8e3ac9ddd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30052024-12-19T06:03:17.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9fb9df60-ee03-418a-849b-c6a8e3ac9ddd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30062024-12-19T06:03:17.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9fb9df60-ee03-418a-849b-c6a8e3ac9ddd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30072024-12-19T06:03:18.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a0c5f23a-f8e3-4a89-9c81-788ab4ceacb1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30082024-12-19T06:03:18.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a0c5f23a-f8e3-4a89-9c81-788ab4ceacb1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30092024-12-19T06:03:18.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a0c5f23a-f8e3-4a89-9c81-788ab4ceacb1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30102024-12-19T06:03:18.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
30112024-12-19T06:03:18.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
30122024-12-19T06:03:18.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30132024-12-19T06:03:18.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30142024-12-19T06:03:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30152024-12-19T06:03:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30162024-12-19T06:03:18.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30172024-12-19T06:03:18.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30182024-12-19T06:03:18.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30192024-12-19T06:03:18.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.056871ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30202024-12-19T06:03:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30212024-12-19T06:03:18.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30222024-12-19T06:03:18.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30232024-12-19T06:03:18.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30242024-12-19T06:03:18.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30252024-12-19T06:03:18.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30262024-12-19T06:03:18.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
30272024-12-19T06:03:18.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30282024-12-19T06:03:18.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30292024-12-19T06:03:18.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
30302024-12-19T06:03:18.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.440996ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
30312024-12-19T06:03:19.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f9f4cdab-8714-493f-855e-34967051d079 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30322024-12-19T06:03:19.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f9f4cdab-8714-493f-855e-34967051d079 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30332024-12-19T06:03:19.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f9f4cdab-8714-493f-855e-34967051d079 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30342024-12-19T06:03:20.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 49e3f8d5-547b-4cd5-857a-1ad67c34c958 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30352024-12-19T06:03:20.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 49e3f8d5-547b-4cd5-857a-1ad67c34c958 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30362024-12-19T06:03:20.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 49e3f8d5-547b-4cd5-857a-1ad67c34c958 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30372024-12-19T06:03:21.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e9aad237-2e2f-4f73-a1ae-805aa860f024 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30382024-12-19T06:03:21.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e9aad237-2e2f-4f73-a1ae-805aa860f024 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30392024-12-19T06:03:21.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e9aad237-2e2f-4f73-a1ae-805aa860f024 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30402024-12-19T06:03:22.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8a713b09-25c3-4a95-9d62-c8d46a93ec05 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30412024-12-19T06:03:22.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8a713b09-25c3-4a95-9d62-c8d46a93ec05 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30422024-12-19T06:03:22.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8a713b09-25c3-4a95-9d62-c8d46a93ec05 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30432024-12-19T06:03:23.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec6bc048-53de-437c-b0ad-8553a11659b1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30442024-12-19T06:03:23.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec6bc048-53de-437c-b0ad-8553a11659b1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30452024-12-19T06:03:23.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec6bc048-53de-437c-b0ad-8553a11659b1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30462024-12-19T06:03:24.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 221c04c8-6d48-4e60-8cd0-725d8988f909 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30472024-12-19T06:03:24.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 221c04c8-6d48-4e60-8cd0-725d8988f909 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30482024-12-19T06:03:24.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 221c04c8-6d48-4e60-8cd0-725d8988f909 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30492024-12-19T06:03:24.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 426 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 49844f67-595c-448c-8a6c-24b17e2c4371 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
30502024-12-19T06:03:25.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = beab652e-a442-4d7a-8bd2-b251aefe5ff1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30512024-12-19T06:03:25.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = beab652e-a442-4d7a-8bd2-b251aefe5ff1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30522024-12-19T06:03:25.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = beab652e-a442-4d7a-8bd2-b251aefe5ff1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30532024-12-19T06:03:26.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d5e84a25-ff4d-421f-a21d-07206d031c85 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30542024-12-19T06:03:26.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d5e84a25-ff4d-421f-a21d-07206d031c85 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30552024-12-19T06:03:26.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d5e84a25-ff4d-421f-a21d-07206d031c85 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30562024-12-19T06:03:27.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cf692a95-0983-4100-ad58-1afb58f239a3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30572024-12-19T06:03:27.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cf692a95-0983-4100-ad58-1afb58f239a3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30582024-12-19T06:03:27.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cf692a95-0983-4100-ad58-1afb58f239a3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30592024-12-19T06:03:28.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d5be3099-121b-4917-ad70-7eb4f6ae329b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30602024-12-19T06:03:28.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d5be3099-121b-4917-ad70-7eb4f6ae329b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30612024-12-19T06:03:28.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d5be3099-121b-4917-ad70-7eb4f6ae329b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30622024-12-19T06:03:28.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
30632024-12-19T06:03:28.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
30642024-12-19T06:03:28.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30652024-12-19T06:03:28.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30662024-12-19T06:03:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30672024-12-19T06:03:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30682024-12-19T06:03:28.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30692024-12-19T06:03:28.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30702024-12-19T06:03:28.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30712024-12-19T06:03:28.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.906106ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30722024-12-19T06:03:28.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30732024-12-19T06:03:28.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30742024-12-19T06:03:28.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30752024-12-19T06:03:28.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30762024-12-19T06:03:28.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30772024-12-19T06:03:28.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30782024-12-19T06:03:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
30792024-12-19T06:03:28.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30802024-12-19T06:03:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30812024-12-19T06:03:28.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
30822024-12-19T06:03:28.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.600152ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
30832024-12-19T06:03:29.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f698aca0-0a69-407f-96ca-0a8b3b3ffe52 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30842024-12-19T06:03:29.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f698aca0-0a69-407f-96ca-0a8b3b3ffe52 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30852024-12-19T06:03:29.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f698aca0-0a69-407f-96ca-0a8b3b3ffe52 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30862024-12-19T06:03:30.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4f7ddbc4-ff57-4466-9204-c83e3faa5eb0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30872024-12-19T06:03:30.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4f7ddbc4-ff57-4466-9204-c83e3faa5eb0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30882024-12-19T06:03:30.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4f7ddbc4-ff57-4466-9204-c83e3faa5eb0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30892024-12-19T06:03:31.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 542c234c-efb7-4b76-93d3-e2eec1acf525 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30902024-12-19T06:03:31.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 542c234c-efb7-4b76-93d3-e2eec1acf525 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30912024-12-19T06:03:31.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 542c234c-efb7-4b76-93d3-e2eec1acf525 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30922024-12-19T06:03:32.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aa9773a4-27da-4903-8073-13813d0eabc3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30932024-12-19T06:03:32.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aa9773a4-27da-4903-8073-13813d0eabc3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30942024-12-19T06:03:32.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aa9773a4-27da-4903-8073-13813d0eabc3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30952024-12-19T06:03:33.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1f9fc533-05b6-4235-8138-6d3aff5c4c4e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30962024-12-19T06:03:33.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1f9fc533-05b6-4235-8138-6d3aff5c4c4e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30972024-12-19T06:03:33.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1f9fc533-05b6-4235-8138-6d3aff5c4c4e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30982024-12-19T06:03:34.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8270cda1-6670-4f17-baf3-d26b2e65fb64 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
30992024-12-19T06:03:34.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8270cda1-6670-4f17-baf3-d26b2e65fb64 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31002024-12-19T06:03:34.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8270cda1-6670-4f17-baf3-d26b2e65fb64 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31012024-12-19T06:03:34.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = cf75894e-d6bf-4c05-9c8a-b00e449c6717 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
31022024-12-19T06:03:35.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6579db16-9419-4445-a99c-93a2332f20e0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31032024-12-19T06:03:35.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6579db16-9419-4445-a99c-93a2332f20e0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31042024-12-19T06:03:35.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6579db16-9419-4445-a99c-93a2332f20e0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31052024-12-19T06:03:36.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9fbe0112-c3cb-4752-aa12-689c948c5bb5 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31062024-12-19T06:03:36.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9fbe0112-c3cb-4752-aa12-689c948c5bb5 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31072024-12-19T06:03:36.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9fbe0112-c3cb-4752-aa12-689c948c5bb5 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31082024-12-19T06:03:37.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 279b0707-1db5-46a6-a4ed-f69f451f9da0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31092024-12-19T06:03:37.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 279b0707-1db5-46a6-a4ed-f69f451f9da0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31102024-12-19T06:03:37.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 279b0707-1db5-46a6-a4ed-f69f451f9da0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31112024-12-19T06:03:38.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 50ee0262-40d6-45c0-9ae6-fc17175dfcc9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31122024-12-19T06:03:38.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 50ee0262-40d6-45c0-9ae6-fc17175dfcc9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31132024-12-19T06:03:38.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 50ee0262-40d6-45c0-9ae6-fc17175dfcc9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
31142024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
31152024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
31162024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
31172024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31182024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31192024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31202024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
31212024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31222024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
31232024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
31242024-12-19T06:03:38.761ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 05:53:38.761618544 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31252024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31262024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31272024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
31282024-12-19T06:03:38.761ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
31292024-12-19T06:03:38.761ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
31302024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
31312024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31322024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31332024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
31342024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31352024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
31362024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
31372024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31382024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
31392024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31402024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31412024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
31422024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31432024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
31442024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31452024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
31462024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31472024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
31482024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
31492024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31502024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31512024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
31522024-12-19T06:03:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
31532024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31542024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
31552024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31562024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31572024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31582024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
31592024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
31602024-12-19T06:03:38.762ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31612024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31622024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
31632024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
31642024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
31652024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
31662024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31672024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
31682024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
31692024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31702024-12-19T06:03:38.762ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
31712024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31722024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
31732024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31742024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
31752024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
31762024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31772024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
31782024-12-19T06:03:38.762ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31792024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31802024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
31812024-12-19T06:03:38.762ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ec4c486a-8de5-4892-b4b1-13175064de2e
31822024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.42\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e"}
31832024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
31842024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31852024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31862024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31872024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31882024-12-19T06:03:38.762ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
31892024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31902024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31912024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31922024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31932024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31942024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31952024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31962024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31972024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31982024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31992024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32002024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32012024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32022024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32032024-12-19T06:03:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("75a56219-191b-4e5c-8eb1-d0e62e0c42f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 477982739 } })
32042024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32052024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32062024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32072024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32082024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32092024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32102024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32112024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32122024-12-19T06:03:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ecedc0eb-6c7d-4958-9fee-747c67187e55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 478117903 } })
32132024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32142024-12-19T06:03:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.101785ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32152024-12-19T06:03:38.763ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
32162024-12-19T06:03:38.763ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.137267ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
32172024-12-19T06:03:38.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32182024-12-19T06:03:38.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32192024-12-19T06:03:38.765ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 480617153 } })
32202024-12-19T06:03:38.765ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.508743ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32212024-12-19T06:03:38.765ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32222024-12-19T06:03:38.766ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32232024-12-19T06:03:38.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32242024-12-19T06:03:38.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32252024-12-19T06:03:38.767ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 05:53:38.761618544 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32262024-12-19T06:03:38.767ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.9164ms iteration = 11 status = {"expiration":"2024-12-19T05:53:38.761618544Z","pruned":[]}
32272024-12-19T06:03:38.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32282024-12-19T06:03:38.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32292024-12-19T06:03:38.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32302024-12-19T06:03:38.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32312024-12-19T06:03:38.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32322024-12-19T06:03:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32332024-12-19T06:03:38.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32342024-12-19T06:03:38.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32352024-12-19T06:03:38.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32362024-12-19T06:03:38.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32372024-12-19T06:03:38.771ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 487266648 } })
32382024-12-19T06:03:38.772ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
32392024-12-19T06:03:38.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32402024-12-19T06:03:38.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32412024-12-19T06:03:38.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32422024-12-19T06:03:38.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32432024-12-19T06:03:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32442024-12-19T06:03:38.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32452024-12-19T06:03:38.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32462024-12-19T06:03:38.775ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32472024-12-19T06:03:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32482024-12-19T06:03:38.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32492024-12-19T06:03:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32502024-12-19T06:03:38.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32512024-12-19T06:03:38.778ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32522024-12-19T06:03:38.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32532024-12-19T06:03:38.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32542024-12-19T06:03:38.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32552024-12-19T06:03:38.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32562024-12-19T06:03:38.781ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32572024-12-19T06:03:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32582024-12-19T06:03:38.783ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.41616ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
32592024-12-19T06:03:38.785ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32602024-12-19T06:03:38.785ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32612024-12-19T06:03:38.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32622024-12-19T06:03:38.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32632024-12-19T06:03:38.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 26.766973ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32642024-12-19T06:03:38.788ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32652024-12-19T06:03:38.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32662024-12-19T06:03:38.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32672024-12-19T06:03:38.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32682024-12-19T06:03:38.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32692024-12-19T06:03:38.791ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 506913301 } })
32702024-12-19T06:03:38.791ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
32712024-12-19T06:03:38.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32722024-12-19T06:03:38.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32732024-12-19T06:03:38.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32742024-12-19T06:03:38.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32752024-12-19T06:03:38.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32762024-12-19T06:03:38.796ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32772024-12-19T06:03:38.796ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.44185ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32782024-12-19T06:03:38.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.924609ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
32792024-12-19T06:03:38.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32802024-12-19T06:03:38.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32812024-12-19T06:03:38.804ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
32822024-12-19T06:03:38.804ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 43.335547ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
32832024-12-19T06:03:38.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32842024-12-19T06:03:38.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32852024-12-19T06:03:38.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32862024-12-19T06:03:38.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32872024-12-19T06:03:38.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32882024-12-19T06:03:38.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32892024-12-19T06:03:38.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32902024-12-19T06:03:38.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32912024-12-19T06:03:38.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32922024-12-19T06:03:38.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
32932024-12-19T06:03:38.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32942024-12-19T06:03:38.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32952024-12-19T06:03:38.814ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32962024-12-19T06:03:38.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32972024-12-19T06:03:38.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32982024-12-19T06:03:38.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32992024-12-19T06:03:38.816ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33002024-12-19T06:03:38.816ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33012024-12-19T06:03:38.816ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.152307ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33022024-12-19T06:03:38.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33032024-12-19T06:03:38.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33042024-12-19T06:03:38.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33052024-12-19T06:03:38.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33062024-12-19T06:03:38.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33072024-12-19T06:03:38.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082024-12-19T06:03:38.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33092024-12-19T06:03:38.826ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33102024-12-19T06:03:38.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33112024-12-19T06:03:38.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33122024-12-19T06:03:38.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33132024-12-19T06:03:38.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33142024-12-19T06:03:38.829ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
33152024-12-19T06:03:38.829ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.425252ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
33162024-12-19T06:03:38.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33172024-12-19T06:03:38.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33182024-12-19T06:03:38.831ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-12-19T06:03:38.832ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33202024-12-19T06:03:38.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33212024-12-19T06:03:38.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33222024-12-19T06:03:38.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33232024-12-19T06:03:38.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33242024-12-19T06:03:38.833ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
33252024-12-19T06:03:38.833ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33262024-12-19T06:03:38.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33272024-12-19T06:03:38.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.007812ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33282024-12-19T06:03:38.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33292024-12-19T06:03:38.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.827939ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
33302024-12-19T06:03:38.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33312024-12-19T06:03:38.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33322024-12-19T06:03:38.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33332024-12-19T06:03:38.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33342024-12-19T06:03:38.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33352024-12-19T06:03:38.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33362024-12-19T06:03:38.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33372024-12-19T06:03:38.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33382024-12-19T06:03:38.841ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33392024-12-19T06:03:38.841ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33402024-12-19T06:03:38.841ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.853343ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33412024-12-19T06:03:38.842ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(c54f3249-a749-45a1-bceb-d407c4171294, 0), (e88f219d-4ea7-48f3-a1fd-17f006c28903, 0), (04eb8f4e-6bef-49d4-9cc8-95fede1b6cb3, 0), (a520bd2b-9452-4a19-bee8-77668d56303d, 0)] collection_id = c54f3249-a749-45a1-bceb-d407c4171294
33422024-12-19T06:03:38.842ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33432024-12-19T06:03:38.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33442024-12-19T06:03:38.843ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33452024-12-19T06:03:38.843ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33462024-12-19T06:03:38.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33472024-12-19T06:03:38.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33482024-12-19T06:03:38.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33492024-12-19T06:03:38.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33502024-12-19T06:03:38.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33512024-12-19T06:03:38.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33522024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33532024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33542024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33552024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33562024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33572024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33582024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33592024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33602024-12-19T06:03:38.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33612024-12-19T06:03:38.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33622024-12-19T06:03:38.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33632024-12-19T06:03:38.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33642024-12-19T06:03:38.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33652024-12-19T06:03:38.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33662024-12-19T06:03:38.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33672024-12-19T06:03:38.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33682024-12-19T06:03:38.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33692024-12-19T06:03:38.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33702024-12-19T06:03:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33712024-12-19T06:03:38.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33722024-12-19T06:03:38.853ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33732024-12-19T06:03:38.853ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33742024-12-19T06:03:38.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33752024-12-19T06:03:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33762024-12-19T06:03:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33772024-12-19T06:03:38.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33782024-12-19T06:03:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33792024-12-19T06:03:38.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33802024-12-19T06:03:38.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33812024-12-19T06:03:38.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33822024-12-19T06:03:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33832024-12-19T06:03:38.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33842024-12-19T06:03:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33852024-12-19T06:03:38.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33862024-12-19T06:03:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33872024-12-19T06:03:38.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.803823ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33882024-12-19T06:03:38.869ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33892024-12-19T06:03:38.869ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33902024-12-19T06:03:38.869ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33912024-12-19T06:03:38.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33922024-12-19T06:03:38.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33932024-12-19T06:03:38.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33942024-12-19T06:03:38.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
33952024-12-19T06:03:38.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33962024-12-19T06:03:38.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33972024-12-19T06:03:38.883ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33982024-12-19T06:03:38.883ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33992024-12-19T06:03:38.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.204195ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34002024-12-19T06:03:38.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34012024-12-19T06:03:38.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34022024-12-19T06:03:38.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34032024-12-19T06:03:38.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34042024-12-19T06:03:38.911ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34052024-12-19T06:03:38.911ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34062024-12-19T06:03:38.911ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b12e184b-825e-4456-9af6-261513183532", "content-length": "26", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
34072024-12-19T06:03:38.911ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34082024-12-19T06:03:38.913ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34092024-12-19T06:03:38.919ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34102024-12-19T06:03:38.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 157.66963ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34112024-12-19T06:03:38.924ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = c54f3249-a749-45a1-bceb-d407c4171294 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
34122024-12-19T06:03:38.924ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34132024-12-19T06:03:38.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34142024-12-19T06:03:38.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
34152024-12-19T06:03:38.927ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34162024-12-19T06:03:38.928ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ce1071d-cae6-41fc-975e-3839fccf6128", "content-length": "26", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
34172024-12-19T06:03:38.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34182024-12-19T06:03:38.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
34192024-12-19T06:03:38.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34202024-12-19T06:03:38.936ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34212024-12-19T06:03:38.936ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a8a138e-aafa-4f20-b1b8-cc12d4bc1575", "content-length": "26", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
34222024-12-19T06:03:38.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34232024-12-19T06:03:38.937ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.696511ms iteration = 23 status = {"physical_disks_added":0}
34242024-12-19T06:03:38.938ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34252024-12-19T06:03:38.989ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34262024-12-19T06:03:38.989ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34272024-12-19T06:03:38.989ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "849b4b77-4594-449c-84a5-6fdea168ad14", "content-length": "372", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
34282024-12-19T06:03:38.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34292024-12-19T06:03:38.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34302024-12-19T06:03:38.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34312024-12-19T06:03:38.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34322024-12-19T06:03:38.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332024-12-19T06:03:38.992ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34342024-12-19T06:03:38.992ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34352024-12-19T06:03:38.992ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 05:54:06.714960 UTC dns_group = internal generation = 1
34362024-12-19T06:03:38.992ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 231.167538ms iteration = 11 status = {"generation":1}
34372024-12-19T06:03:38.993ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 231.690964ms iteration = 21 status = 0
34382024-12-19T06:03:38.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34392024-12-19T06:03:38.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34402024-12-19T06:03:38.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34412024-12-19T06:03:38.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34422024-12-19T06:03:38.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34432024-12-19T06:03:38.997ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(e88f219d-4ea7-48f3-a1fd-17f006c28903, 0), (04eb8f4e-6bef-49d4-9cc8-95fede1b6cb3, 0), (a520bd2b-9452-4a19-bee8-77668d56303d, 0)]
34442024-12-19T06:03:38.997ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 713413983 } })
34452024-12-19T06:03:38.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34462024-12-19T06:03:39.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
34472024-12-19T06:03:39.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34482024-12-19T06:03:39.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34492024-12-19T06:03:39.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34502024-12-19T06:03:39.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34512024-12-19T06:03:39.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34522024-12-19T06:03:39.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34532024-12-19T06:03:39.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34542024-12-19T06:03:39.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34552024-12-19T06:03:39.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34562024-12-19T06:03:39.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34572024-12-19T06:03:39.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34582024-12-19T06:03:39.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34592024-12-19T06:03:39.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34602024-12-19T06:03:39.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34612024-12-19T06:03:39.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622024-12-19T06:03:39.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632024-12-19T06:03:39.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 263.081885ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34642024-12-19T06:03:39.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34652024-12-19T06:03:39.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34662024-12-19T06:03:39.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34672024-12-19T06:03:39.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
34682024-12-19T06:03:39.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34692024-12-19T06:03:39.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34702024-12-19T06:03:39.044ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34712024-12-19T06:03:39.044ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34722024-12-19T06:03:39.044ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9e0a8cf4-7baf-45a7-b59f-ef328d27f858", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
34732024-12-19T06:03:39.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34742024-12-19T06:03:39.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34752024-12-19T06:03:39.045ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T05:53:28.550897Z, time_modified: 2024-12-19T05:53:28.550897Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }) }
34762024-12-19T06:03:39.045ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 283.454302ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]}},"default_endpoint":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34772024-12-19T06:03:39.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34782024-12-19T06:03:39.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34792024-12-19T06:03:39.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34802024-12-19T06:03:39.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34812024-12-19T06:03:39.053ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34822024-12-19T06:03:39.053ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34832024-12-19T06:03:39.053ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "48d52b26-da87-487a-bd3d-a1c445d46d50", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
34842024-12-19T06:03:39.054ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.050411ms iteration = 21 status = {}
34852024-12-19T06:03:39.055ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34862024-12-19T06:03:39.055ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 0 version = 2
34872024-12-19T06:03:39.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34882024-12-19T06:03:39.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34892024-12-19T06:03:39.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34902024-12-19T06:03:39.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34912024-12-19T06:03:39.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34922024-12-19T06:03:39.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34932024-12-19T06:03:39.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34942024-12-19T06:03:39.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34952024-12-19T06:03:39.065ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 1 version = 2
34962024-12-19T06:03:39.065ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34972024-12-19T06:03:39.065ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 05:54:07.672295 UTC dns_group = external generation = 2
34982024-12-19T06:03:39.065ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.431846ms iteration = 11 status = {"generation":2}
34992024-12-19T06:03:39.078ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35002024-12-19T06:03:39.079ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a6359352-e878-4ad1-8e60-e0ef2e3256ca", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35012024-12-19T06:03:39.079ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35022024-12-19T06:03:39.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e3bdb5ca-ba3a-4e6f-b041-b3c8fce2a435", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35032024-12-19T06:03:39.080ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35042024-12-19T06:03:39.082ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35052024-12-19T06:03:39.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 320.495636ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35062024-12-19T06:03:39.083ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.616201ms iteration = 21 status = {}
35072024-12-19T06:03:39.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35082024-12-19T06:03:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35092024-12-19T06:03:39.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35102024-12-19T06:03:39.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
35112024-12-19T06:03:39.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35122024-12-19T06:03:39.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35132024-12-19T06:03:39.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35142024-12-19T06:03:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35152024-12-19T06:03:39.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35162024-12-19T06:03:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35172024-12-19T06:03:39.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182024-12-19T06:03:39.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35192024-12-19T06:03:39.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35202024-12-19T06:03:39.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35212024-12-19T06:03:39.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35222024-12-19T06:03:39.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35232024-12-19T06:03:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35242024-12-19T06:03:39.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35252024-12-19T06:03:39.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35262024-12-19T06:03:39.103ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35272024-12-19T06:03:39.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35282024-12-19T06:03:39.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35292024-12-19T06:03:39.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35302024-12-19T06:03:39.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35312024-12-19T06:03:39.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35322024-12-19T06:03:39.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35332024-12-19T06:03:39.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35342024-12-19T06:03:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35352024-12-19T06:03:39.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35362024-12-19T06:03:39.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35372024-12-19T06:03:39.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35382024-12-19T06:03:39.111ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35392024-12-19T06:03:39.111ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d443bb3a-a32b-4345-bcd5-478f8d62dfa9", "content-length": "1", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35402024-12-19T06:03:39.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35412024-12-19T06:03:39.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35422024-12-19T06:03:39.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35432024-12-19T06:03:39.113ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35442024-12-19T06:03:39.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35452024-12-19T06:03:39.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35462024-12-19T06:03:39.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35472024-12-19T06:03:39.137ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35482024-12-19T06:03:39.246ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35492024-12-19T06:03:39.247ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "170aa722-27c8-43f8-99f6-72d584e933f0", "content-length": "691", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35502024-12-19T06:03:39.247ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35512024-12-19T06:03:39.247ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35522024-12-19T06:03:39.247ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35532024-12-19T06:03:39.247ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 486.137662ms iteration = 21 status = {}
35542024-12-19T06:03:39.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35552024-12-19T06:03:39.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35562024-12-19T06:03:39.251ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 490.151891ms iteration = 21 status = null
35572024-12-19T06:03:39.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35582024-12-19T06:03:39.255ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
35592024-12-19T06:03:39.255ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
35602024-12-19T06:03:39.255ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
35612024-12-19T06:03:39.255ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "204c136e-77e8-4550-83e8-68405db6d139", "content-length": "476", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35622024-12-19T06:03:39.255ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
35632024-12-19T06:03:39.255ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "688e7ed8-ce1c-4d02-8b97-a0f868d81801", "content-length": "734", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35642024-12-19T06:03:39.255ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
35652024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8783373-1d8f-4c47-ae0b-c3f8ad759e57", "content-length": "111", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35662024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
35672024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35682024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35692024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b25287db-cdef-46a9-9d3c-96c718e1a523", "content-length": "111", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35702024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
35712024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35722024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9553e65-7b86-4f21-98a3-8747797317af", "content-length": "167", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35732024-12-19T06:03:39.256ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
35742024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7acbe0e6-cfa3-4776-94af-795211d1ebac", "content-length": "167", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35752024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
35762024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "52c47314-bd28-417d-b483-4506800e2bb1", "content-length": "175", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35772024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
35782024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8005808f-f1ed-400a-85b5-bc2e6e8195b6", "content-length": "175", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35792024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
35802024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4db99800-0139-481c-9ef8-093a94486f0e", "content-length": "702", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35812024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
35822024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a6fb318-7fc3-4081-9d3b-938376bf2aae", "content-length": "727", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35832024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
35842024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "15670f25-fb9a-4fec-bbf5-c95a4d4c2196", "content-length": "729", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
35852024-12-19T06:03:39.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
35862024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "84d4f261-015d-4ccd-a116-87850a6ed6b3", "content-length": "728", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
35872024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
35882024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "78c194be-40f1-4e34-b5e1-5c761e73aaf9", "content-length": "722", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
35892024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
35902024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "74b9a262-0aec-4d65-8f45-1179b778d483", "content-length": "109", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
35912024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
35922024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a26016fe-753a-4ca1-8436-207920caf7c7", "content-length": "109", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
35932024-12-19T06:03:39.258ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
35942024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "20f75bdc-474c-45ca-a275-1e1a5efe355c", "content-length": "169", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
35952024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
35962024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e06ea950-6b40-47d8-84c7-775824715202", "content-length": "169", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
35972024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
35982024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f52d1de-05fe-4bb8-8188-282bd40b09b0", "content-length": "178", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
35992024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
36002024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "73533206-db1d-416a-a1ff-928d6b3310e6", "content-length": "178", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36012024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
36022024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "797d827c-62c5-4977-83dc-4dc383ef7295", "content-length": "702", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36032024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
36042024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e153330-f5c9-4f57-a9de-9cade1f3d915", "content-length": "727", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36052024-12-19T06:03:39.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
36062024-12-19T06:03:39.260ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf4ebf0f-8701-4ecb-b3dd-0e524b766f95", "content-length": "729", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36072024-12-19T06:03:39.260ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
36082024-12-19T06:03:39.260ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7c47db4-9f2b-406d-9645-27dd0e47995e", "content-length": "728", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36092024-12-19T06:03:39.260ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36102024-12-19T06:03:39.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36112024-12-19T06:03:39.262ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36122024-12-19T06:03:39.264ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
36132024-12-19T06:03:39.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36142024-12-19T06:03:39.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
36152024-12-19T06:03:39.264ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36162024-12-19T06:03:39.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36172024-12-19T06:03:39.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36182024-12-19T06:03:39.265ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36192024-12-19T06:03:39.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202024-12-19T06:03:39.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
36212024-12-19T06:03:39.268ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36222024-12-19T06:03:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36232024-12-19T06:03:39.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
36242024-12-19T06:03:39.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36252024-12-19T06:03:39.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36262024-12-19T06:03:39.270ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
36272024-12-19T06:03:39.270ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9a77c36e-7345-430e-9e83-8c3363325e9b, kind: Service { id: 75a56219-191b-4e5c-8eb1-d0e62e0c42f9 }, name: Name("external-dns-75a56219-191b-4e5c-8eb1-d0e62e0c42f9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 10])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9edfb32a-e2bb-4e56-b9b4-ce860f893b5e, kind: Service { id: bb4845ab-0600-4d61-a9f2-eb93a7cc0896 }, name: Name("external-dns-bb4845ab-0600-4d61-a9f2-eb93a7cc0896"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 241])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 24da1f38-f5d2-4b50-a6f0-27b3479e0f93, kind: Service { id: 1b05e3ee-34fc-4615-91df-a477e1a37258 }, name: Name("nexus-1b05e3ee-34fc-4615-91df-a477e1a37258"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 37828052-0f7a-4cca-a068-121a8b67e439, kind: Service { id: c32c373d-ccc1-45e0-bb27-49a4415e7fca }, name: Name("nexus-c32c373d-ccc1-45e0-bb27-49a4415e7fca"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a59ef66c-a1c5-4c9a-a337-f2d47efa332a, kind: Service { id: 1e0292d6-c327-472e-85e6-622aab78d10f }, name: Name("nexus-1e0292d6-c327-472e-85e6-622aab78d10f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 229])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
36282024-12-19T06:03:39.270ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
36292024-12-19T06:03:39.291ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36302024-12-19T06:03:39.291ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8dfa4917-f259-4693-9894-755d2201c9cc", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36312024-12-19T06:03:39.291ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36322024-12-19T06:03:39.293ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8e455e56-33f7-4653-b625-f39c97361ee7", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36332024-12-19T06:03:39.293ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36342024-12-19T06:03:39.295ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0ca9f1fb-6f35-4d0d-888b-8402d45465b6", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36352024-12-19T06:03:39.295ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36362024-12-19T06:03:39.298ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36372024-12-19T06:03:39.298ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 536.09205ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36382024-12-19T06:03:39.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36392024-12-19T06:03:39.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36402024-12-19T06:03:39.314ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
36412024-12-19T06:03:39.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36422024-12-19T06:03:39.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36432024-12-19T06:03:39.322ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: a9851483-adb5-4271-9f27-41db71133b55, time_created: 2024-12-19T05:54:00.621685Z, time_modified: 2024-12-19T05:54:00.621685Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
36442024-12-19T06:03:39.322ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
36452024-12-19T06:03:39.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36462024-12-19T06:03:39.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36472024-12-19T06:03:39.322ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
36482024-12-19T06:03:39.322ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
36492024-12-19T06:03:39.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36502024-12-19T06:03:39.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36512024-12-19T06:03:39.325ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "89003c71-55fe-4c43-8401-7990c2e13496", "content-length": "134", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
36522024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36532024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
36542024-12-19T06:03:39.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36552024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36562024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36572024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36582024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36592024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36602024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36612024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36622024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36632024-12-19T06:03:39.325ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
36642024-12-19T06:03:39.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36652024-12-19T06:03:39.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36662024-12-19T06:03:39.326ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36672024-12-19T06:03:39.327ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36682024-12-19T06:03:39.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b38fbdcc-a813-4b6d-9605-e5b074629e32", "content-length": "2", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
36692024-12-19T06:03:39.328ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36702024-12-19T06:03:39.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd78caa6-92fb-42ff-890b-69bd65a1988c", "content-length": "52", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
36712024-12-19T06:03:39.328ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
36722024-12-19T06:03:39.328ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36732024-12-19T06:03:39.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
36742024-12-19T06:03:39.360ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
36752024-12-19T06:03:39.390ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "eef0ff06-e846-40b4-80e2-fbddd6dcd07e", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36762024-12-19T06:03:39.391ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
36772024-12-19T06:03:39.391ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 630.049047ms
36782024-12-19T06:03:39.391ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 630.057778ms iteration = 3 status = {}
36792024-12-19T06:03:39.436ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1a0caeea-0d61-4cb8-9431-0bbbd2fadf4e", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36802024-12-19T06:03:39.436ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
36812024-12-19T06:03:39.436ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36822024-12-19T06:03:39.436ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f833adc-8564-4cba-809d-8f9b302a4efa", "content-length": "682", "date": "Thu, 19 Dec 2024 06:03:39 GMT"} })
36832024-12-19T06:03:39.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36842024-12-19T06:03:39.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36852024-12-19T06:03:39.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36862024-12-19T06:03:39.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36872024-12-19T06:03:39.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36882024-12-19T06:03:39.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36892024-12-19T06:03:39.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36902024-12-19T06:03:39.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36912024-12-19T06:03:39.452ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 690.706352ms iteration = 21 status = {}
36922024-12-19T06:03:39.585ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a23ee1a-cdba-4f20-ac3a-b1e4dfd05666", "content-length": "30797", "date": "Thu, 19 Dec 2024 06:03:38 GMT"} })
36932024-12-19T06:03:39.587ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36942024-12-19T06:03:39.587ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36952024-12-19T06:03:39.587ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
36962024-12-19T06:03:39.589ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36972024-12-19T06:03:39.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36982024-12-19T06:03:39.591ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36992024-12-19T06:03:39.593ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
37002024-12-19T06:03:39.593ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37012024-12-19T06:03:39.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37022024-12-19T06:03:39.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b522f848-2b6b-4e0d-a030-0165a6b5a5ce roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37032024-12-19T06:03:39.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b522f848-2b6b-4e0d-a030-0165a6b5a5ce resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37042024-12-19T06:03:39.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b522f848-2b6b-4e0d-a030-0165a6b5a5ce response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37052024-12-19T06:03:39.771ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 5adaa95f-2cdf-48f5-9f00-295390215fb4 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
37062024-12-19T06:03:39.771ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 5adaa95f-2cdf-48f5-9f00-295390215fb4 time_started = 2024-12-19 06:03:39.255103 UTC
37072024-12-19T06:03:39.771ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.009904115s iteration = 3 status = {"collection_id":"5adaa95f-2cdf-48f5-9f00-295390215fb4","time_done":"2024-12-19 06:03:39.587941 UTC","time_started":"2024-12-19 06:03:39.255103 UTC"}
37082024-12-19T06:03:39.771ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
37092024-12-19T06:03:39.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37102024-12-19T06:03:39.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37112024-12-19T06:03:39.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122024-12-19T06:03:39.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37132024-12-19T06:03:39.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37142024-12-19T06:03:39.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37152024-12-19T06:03:39.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37162024-12-19T06:03:39.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37172024-12-19T06:03:39.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37182024-12-19T06:03:39.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37192024-12-19T06:03:39.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37202024-12-19T06:03:39.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37212024-12-19T06:03:39.792ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 20.625805ms iteration = 24 status = {"physical_disks_added":0}
37222024-12-19T06:03:40.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ca652d6c-d0a2-460f-8b37-d410e946e012 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37232024-12-19T06:03:40.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ca652d6c-d0a2-460f-8b37-d410e946e012 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37242024-12-19T06:03:40.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ca652d6c-d0a2-460f-8b37-d410e946e012 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37252024-12-19T06:03:41.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dbff8a4c-6544-47fa-b2d4-d4537f338d2d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37262024-12-19T06:03:41.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dbff8a4c-6544-47fa-b2d4-d4537f338d2d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37272024-12-19T06:03:41.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = dbff8a4c-6544-47fa-b2d4-d4537f338d2d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37282024-12-19T06:03:42.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 88e42dc2-5bfc-4a94-ab3c-34d0e75804e0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37292024-12-19T06:03:42.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 88e42dc2-5bfc-4a94-ab3c-34d0e75804e0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37302024-12-19T06:03:42.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 88e42dc2-5bfc-4a94-ab3c-34d0e75804e0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37312024-12-19T06:03:43.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b9bca623-62ac-4714-a8a2-420998e24444 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37322024-12-19T06:03:43.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b9bca623-62ac-4714-a8a2-420998e24444 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37332024-12-19T06:03:43.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b9bca623-62ac-4714-a8a2-420998e24444 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37342024-12-19T06:03:44.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 38eaacf2-cf94-4f3c-9579-3774842f8410 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37352024-12-19T06:03:44.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 38eaacf2-cf94-4f3c-9579-3774842f8410 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37362024-12-19T06:03:44.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 38eaacf2-cf94-4f3c-9579-3774842f8410 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37372024-12-19T06:03:44.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = e370ec7e-6a26-4955-b6bb-533e71abc8d4 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
37382024-12-19T06:03:45.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8a34e28f-3796-4fd9-abdc-ad70b8c4c10f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37392024-12-19T06:03:45.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8a34e28f-3796-4fd9-abdc-ad70b8c4c10f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37402024-12-19T06:03:45.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8a34e28f-3796-4fd9-abdc-ad70b8c4c10f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37412024-12-19T06:03:46.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d1805049-1420-4197-b226-c7e9caacb81b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37422024-12-19T06:03:46.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d1805049-1420-4197-b226-c7e9caacb81b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37432024-12-19T06:03:46.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d1805049-1420-4197-b226-c7e9caacb81b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37442024-12-19T06:03:47.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5ff211eb-f7ef-4c10-ac8e-4ad061cc2b70 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37452024-12-19T06:03:47.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5ff211eb-f7ef-4c10-ac8e-4ad061cc2b70 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37462024-12-19T06:03:47.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5ff211eb-f7ef-4c10-ac8e-4ad061cc2b70 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37472024-12-19T06:03:48.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
37482024-12-19T06:03:48.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
37492024-12-19T06:03:48.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37502024-12-19T06:03:48.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37512024-12-19T06:03:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37522024-12-19T06:03:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37532024-12-19T06:03:48.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37542024-12-19T06:03:48.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37552024-12-19T06:03:48.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37562024-12-19T06:03:48.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37572024-12-19T06:03:48.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37582024-12-19T06:03:48.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37592024-12-19T06:03:48.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37602024-12-19T06:03:48.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37612024-12-19T06:03:48.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37622024-12-19T06:03:48.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
37632024-12-19T06:03:48.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37642024-12-19T06:03:48.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37652024-12-19T06:03:48.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
37662024-12-19T06:03:48.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.345052ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
37672024-12-19T06:03:48.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.63209ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37682024-12-19T06:03:48.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bc0de9e0-9fe8-4913-ab79-2572853cf47c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37692024-12-19T06:03:48.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bc0de9e0-9fe8-4913-ab79-2572853cf47c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37702024-12-19T06:03:48.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bc0de9e0-9fe8-4913-ab79-2572853cf47c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37712024-12-19T06:03:49.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7ada2c24-28d1-4b85-b0f5-0a1d74d40226 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37722024-12-19T06:03:49.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7ada2c24-28d1-4b85-b0f5-0a1d74d40226 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37732024-12-19T06:03:49.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7ada2c24-28d1-4b85-b0f5-0a1d74d40226 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37742024-12-19T06:03:50.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cc775465-ac6d-4b86-96a5-6a0668b3396a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37752024-12-19T06:03:50.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cc775465-ac6d-4b86-96a5-6a0668b3396a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37762024-12-19T06:03:50.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cc775465-ac6d-4b86-96a5-6a0668b3396a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37772024-12-19T06:03:51.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2ecd431c-a1a2-4700-93d5-f165ebdb1406 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37782024-12-19T06:03:51.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2ecd431c-a1a2-4700-93d5-f165ebdb1406 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37792024-12-19T06:03:51.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2ecd431c-a1a2-4700-93d5-f165ebdb1406 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37802024-12-19T06:03:53.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8ce4d751-acc8-4819-ae03-16ee19e560f5 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37812024-12-19T06:03:53.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8ce4d751-acc8-4819-ae03-16ee19e560f5 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37822024-12-19T06:03:53.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8ce4d751-acc8-4819-ae03-16ee19e560f5 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37832024-12-19T06:03:54.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0a099f45-a47c-48e1-8a63-94de78908c94 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37842024-12-19T06:03:54.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0a099f45-a47c-48e1-8a63-94de78908c94 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37852024-12-19T06:03:54.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0a099f45-a47c-48e1-8a63-94de78908c94 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37862024-12-19T06:03:54.999ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 8c2170b9-6dfc-4b15-a0d9-c12333bf348b response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
37872024-12-19T06:03:55.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = de74104c-8631-4e4e-a00b-015332408515 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37882024-12-19T06:03:55.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = de74104c-8631-4e4e-a00b-015332408515 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37892024-12-19T06:03:55.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = de74104c-8631-4e4e-a00b-015332408515 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37902024-12-19T06:03:56.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 949b8f41-d73f-464b-8c22-654afe2563dd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37912024-12-19T06:03:56.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 949b8f41-d73f-464b-8c22-654afe2563dd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37922024-12-19T06:03:56.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 949b8f41-d73f-464b-8c22-654afe2563dd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37932024-12-19T06:03:57.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ef170266-3acb-4df1-9800-a63d08cce9a9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37942024-12-19T06:03:57.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ef170266-3acb-4df1-9800-a63d08cce9a9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37952024-12-19T06:03:57.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ef170266-3acb-4df1-9800-a63d08cce9a9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37962024-12-19T06:03:58.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a42b3cfa-79eb-4924-835d-123043bc86d4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37972024-12-19T06:03:58.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a42b3cfa-79eb-4924-835d-123043bc86d4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37982024-12-19T06:03:58.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a42b3cfa-79eb-4924-835d-123043bc86d4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
37992024-12-19T06:03:58.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
38002024-12-19T06:03:58.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
38012024-12-19T06:03:58.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38022024-12-19T06:03:58.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38032024-12-19T06:03:58.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38042024-12-19T06:03:58.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-12-19T06:03:58.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38062024-12-19T06:03:58.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38072024-12-19T06:03:58.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38082024-12-19T06:03:58.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.067391ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38092024-12-19T06:03:58.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38102024-12-19T06:03:58.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38112024-12-19T06:03:58.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38122024-12-19T06:03:58.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38132024-12-19T06:03:58.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38142024-12-19T06:03:58.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38152024-12-19T06:03:58.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
38162024-12-19T06:03:58.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38172024-12-19T06:03:58.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38182024-12-19T06:03:58.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
38192024-12-19T06:03:58.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.568659ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
38202024-12-19T06:03:59.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 474bb36a-a190-426e-8bf8-cc4ec0bc1fcb roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38212024-12-19T06:03:59.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 474bb36a-a190-426e-8bf8-cc4ec0bc1fcb resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38222024-12-19T06:03:59.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 474bb36a-a190-426e-8bf8-cc4ec0bc1fcb response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38232024-12-19T06:04:00.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4b9c2afa-c7bd-4030-8399-684ae5bc557d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38242024-12-19T06:04:00.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4b9c2afa-c7bd-4030-8399-684ae5bc557d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38252024-12-19T06:04:00.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4b9c2afa-c7bd-4030-8399-684ae5bc557d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38262024-12-19T06:04:01.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c022448e-0251-4f6c-a9f8-044e9d1e7a3c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38272024-12-19T06:04:01.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c022448e-0251-4f6c-a9f8-044e9d1e7a3c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38282024-12-19T06:04:01.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c022448e-0251-4f6c-a9f8-044e9d1e7a3c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38292024-12-19T06:04:02.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1377638b-356b-4876-8d0b-b988ff6a8a02 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38302024-12-19T06:04:02.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1377638b-356b-4876-8d0b-b988ff6a8a02 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38312024-12-19T06:04:02.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1377638b-356b-4876-8d0b-b988ff6a8a02 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38322024-12-19T06:04:03.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df55fa0b-171d-4604-893c-d1346723ad79 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38332024-12-19T06:04:03.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df55fa0b-171d-4604-893c-d1346723ad79 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38342024-12-19T06:04:03.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df55fa0b-171d-4604-893c-d1346723ad79 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38352024-12-19T06:04:04.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f6b771e8-876c-4ab6-8102-be0b44452d92 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38362024-12-19T06:04:04.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f6b771e8-876c-4ab6-8102-be0b44452d92 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38372024-12-19T06:04:04.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f6b771e8-876c-4ab6-8102-be0b44452d92 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38382024-12-19T06:04:04.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 415 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 8016bfae-2868-41f1-8f06-f3676eb47e17 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
38392024-12-19T06:04:05.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 20e9e0b1-9494-4fae-b307-fcf9e9bdef36 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38402024-12-19T06:04:05.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 20e9e0b1-9494-4fae-b307-fcf9e9bdef36 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38412024-12-19T06:04:05.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 20e9e0b1-9494-4fae-b307-fcf9e9bdef36 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38422024-12-19T06:04:06.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6e1e3aec-6b8e-49c9-9352-004bf59a0d57 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38432024-12-19T06:04:06.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6e1e3aec-6b8e-49c9-9352-004bf59a0d57 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38442024-12-19T06:04:06.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6e1e3aec-6b8e-49c9-9352-004bf59a0d57 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38452024-12-19T06:04:07.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1e34190e-897b-48ee-9b8a-5d20ed30eb62 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38462024-12-19T06:04:07.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1e34190e-897b-48ee-9b8a-5d20ed30eb62 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38472024-12-19T06:04:07.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1e34190e-897b-48ee-9b8a-5d20ed30eb62 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38482024-12-19T06:04:08.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 307a11f8-770c-4554-a91e-b7d398387a26 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38492024-12-19T06:04:08.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 307a11f8-770c-4554-a91e-b7d398387a26 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38502024-12-19T06:04:08.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 307a11f8-770c-4554-a91e-b7d398387a26 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
38512024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
38522024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38532024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
38542024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
38552024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38562024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38572024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
38582024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
38592024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38602024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38612024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
38622024-12-19T06:04:08.761ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38632024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
38642024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38652024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38662024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
38672024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38682024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
38692024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
38702024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38712024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
38722024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38732024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
38742024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
38752024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38762024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38772024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
38782024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
38792024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38802024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38812024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
38822024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38832024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
38842024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38852024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38862024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38872024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38882024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38892024-12-19T06:04:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38902024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38912024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38922024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38932024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38942024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38952024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38962024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38972024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38982024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38992024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39002024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39012024-12-19T06:04:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39022024-12-19T06:04:08.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.327486ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
39032024-12-19T06:04:08.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39042024-12-19T06:04:08.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39052024-12-19T06:04:08.765ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.754041ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39062024-12-19T06:04:08.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-12-19T06:04:08.766ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 482590367 } })
39082024-12-19T06:04:08.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39092024-12-19T06:04:08.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39102024-12-19T06:04:08.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39112024-12-19T06:04:08.767ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39122024-12-19T06:04:08.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39132024-12-19T06:04:08.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39142024-12-19T06:04:08.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 485355266 } })
39152024-12-19T06:04:08.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39162024-12-19T06:04:08.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39172024-12-19T06:04:08.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39182024-12-19T06:04:08.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39192024-12-19T06:04:08.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39202024-12-19T06:04:08.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39212024-12-19T06:04:08.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39222024-12-19T06:04:08.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232024-12-19T06:04:08.773ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39242024-12-19T06:04:08.773ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39252024-12-19T06:04:08.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39262024-12-19T06:04:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39272024-12-19T06:04:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39282024-12-19T06:04:08.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39292024-12-19T06:04:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39302024-12-19T06:04:08.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312024-12-19T06:04:08.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39322024-12-19T06:04:08.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39332024-12-19T06:04:08.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39342024-12-19T06:04:08.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39352024-12-19T06:04:08.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39362024-12-19T06:04:08.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39372024-12-19T06:04:08.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39382024-12-19T06:04:08.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 495611556 } })
39392024-12-19T06:04:08.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
39402024-12-19T06:04:08.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39412024-12-19T06:04:08.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39422024-12-19T06:04:08.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39432024-12-19T06:04:08.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39442024-12-19T06:04:08.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39452024-12-19T06:04:08.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39462024-12-19T06:04:08.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39472024-12-19T06:04:08.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39482024-12-19T06:04:08.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39492024-12-19T06:04:08.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39502024-12-19T06:04:08.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39512024-12-19T06:04:08.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39522024-12-19T06:04:08.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39532024-12-19T06:04:08.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39542024-12-19T06:04:08.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39552024-12-19T06:04:08.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39562024-12-19T06:04:08.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39572024-12-19T06:04:08.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39582024-12-19T06:04:08.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39592024-12-19T06:04:08.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39602024-12-19T06:04:08.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39612024-12-19T06:04:08.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39622024-12-19T06:04:08.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39632024-12-19T06:04:08.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39642024-12-19T06:04:08.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39652024-12-19T06:04:08.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
39662024-12-19T06:04:08.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39672024-12-19T06:04:08.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39682024-12-19T06:04:08.809ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.656055ms iteration = 22 status = 0
39692024-12-19T06:04:08.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39702024-12-19T06:04:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39712024-12-19T06:04:08.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39722024-12-19T06:04:08.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39732024-12-19T06:04:08.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.125745ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
39742024-12-19T06:04:08.829ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39752024-12-19T06:04:08.829ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39762024-12-19T06:04:08.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39772024-12-19T06:04:08.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39782024-12-19T06:04:08.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.684124ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39792024-12-19T06:04:08.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.174301ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39802024-12-19T06:04:08.842ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39812024-12-19T06:04:08.842ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39822024-12-19T06:04:08.842ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe2ccda-a782-4ea0-98c6-9a3e14384a44", "content-length": "26", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
39832024-12-19T06:04:08.842ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39842024-12-19T06:04:08.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39852024-12-19T06:04:08.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39862024-12-19T06:04:08.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.256924ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
39872024-12-19T06:04:08.848ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39882024-12-19T06:04:08.848ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39892024-12-19T06:04:08.848ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca1ad8b4-2f66-4cc2-ba49-1acb75cd9c1b", "content-length": "26", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
39902024-12-19T06:04:08.848ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39912024-12-19T06:04:08.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
39922024-12-19T06:04:08.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39932024-12-19T06:04:08.849ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39942024-12-19T06:04:08.849ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.905292ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39952024-12-19T06:04:08.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39962024-12-19T06:04:08.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.473411ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39972024-12-19T06:04:08.850ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39982024-12-19T06:04:08.859ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
39992024-12-19T06:04:08.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.023498ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
40002024-12-19T06:04:08.866ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40012024-12-19T06:04:08.866ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40022024-12-19T06:04:08.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.288552ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40032024-12-19T06:04:08.868ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
40042024-12-19T06:04:08.868ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40052024-12-19T06:04:08.868ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f02f62c-9e36-4347-aa71-8e3771c6a4dd", "content-length": "26", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40062024-12-19T06:04:08.868ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40072024-12-19T06:04:08.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
40082024-12-19T06:04:08.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40092024-12-19T06:04:08.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40102024-12-19T06:04:08.924ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.934629ms iteration = 25 status = {"physical_disks_added":0}
40112024-12-19T06:04:08.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122024-12-19T06:04:08.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40132024-12-19T06:04:08.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40142024-12-19T06:04:08.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40152024-12-19T06:04:08.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-12-19T06:04:08.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40172024-12-19T06:04:08.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40182024-12-19T06:04:08.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40192024-12-19T06:04:08.936ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40202024-12-19T06:04:08.936ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40212024-12-19T06:04:08.936ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ff5128d-cbda-4452-b57d-888dcdfb73f6", "content-length": "372", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40222024-12-19T06:04:08.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40232024-12-19T06:04:08.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40242024-12-19T06:04:08.937ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 176.491966ms iteration = 22 status = {}
40252024-12-19T06:04:08.946ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40262024-12-19T06:04:08.946ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "26acdae3-1ef9-40c5-807f-9e50f64739c3", "content-length": "1", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40272024-12-19T06:04:08.948ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40282024-12-19T06:04:08.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40292024-12-19T06:04:08.950ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 188.985248ms iteration = 22 status = null
40302024-12-19T06:04:08.951ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
40312024-12-19T06:04:08.951ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40322024-12-19T06:04:08.951ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b7cb455e-057f-46e6-9ed9-9630eea5ce1a", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40332024-12-19T06:04:08.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40342024-12-19T06:04:08.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40352024-12-19T06:04:08.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40362024-12-19T06:04:08.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40372024-12-19T06:04:08.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40382024-12-19T06:04:08.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40392024-12-19T06:04:08.959ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40402024-12-19T06:04:08.959ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40412024-12-19T06:04:08.960ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ca302c58-9940-4bdc-be64-3d8cab7e5cab", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40422024-12-19T06:04:08.961ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 200.711756ms iteration = 22 status = {}
40432024-12-19T06:04:09.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40442024-12-19T06:04:09.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40452024-12-19T06:04:09.028ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
40462024-12-19T06:04:09.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40472024-12-19T06:04:09.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40482024-12-19T06:04:09.043ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40492024-12-19T06:04:09.044ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "77212ec7-b79c-4f85-bfc8-2767168cba30", "content-length": "691", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40502024-12-19T06:04:09.044ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
40512024-12-19T06:04:09.044ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
40522024-12-19T06:04:09.044ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
40532024-12-19T06:04:09.045ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.713693ms iteration = 22 status = {}
40542024-12-19T06:04:09.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40552024-12-19T06:04:09.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "450f1d8b-a3c0-454e-894b-be3554c514a2", "content-length": "134", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40562024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40572024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
40582024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40592024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40602024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40612024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40622024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40632024-12-19T06:04:09.053ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40642024-12-19T06:04:09.054ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40652024-12-19T06:04:09.054ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40662024-12-19T06:04:09.054ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
40672024-12-19T06:04:09.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40682024-12-19T06:04:09.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40692024-12-19T06:04:09.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40702024-12-19T06:04:09.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2838aee8-1a65-43c6-8362-3cfa506325e7", "content-length": "2", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40712024-12-19T06:04:09.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40722024-12-19T06:04:09.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bf41cdd-f179-48b0-a972-a233a8dca438", "content-length": "52", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40732024-12-19T06:04:09.056ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
40742024-12-19T06:04:09.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40752024-12-19T06:04:09.160ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9f09ef56-323e-43d7-8e81-aec6051cb23b", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40762024-12-19T06:04:09.160ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
40772024-12-19T06:04:09.160ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40782024-12-19T06:04:09.160ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7bc306f-bae6-4b05-8585-2402261ac3c0", "content-length": "682", "date": "Thu, 19 Dec 2024 06:04:08 GMT"} })
40792024-12-19T06:04:09.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40802024-12-19T06:04:09.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40812024-12-19T06:04:09.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40822024-12-19T06:04:09.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40832024-12-19T06:04:09.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40842024-12-19T06:04:09.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40852024-12-19T06:04:09.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40862024-12-19T06:04:09.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40872024-12-19T06:04:09.178ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 416.56158ms iteration = 22 status = {}
40882024-12-19T06:04:09.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0794175d-5cc6-4714-8d58-5d23f1a3c8aa roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40892024-12-19T06:04:09.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0794175d-5cc6-4714-8d58-5d23f1a3c8aa resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40902024-12-19T06:04:09.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0794175d-5cc6-4714-8d58-5d23f1a3c8aa response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40912024-12-19T06:04:10.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3d0c5844-6bd0-4699-9b7e-6a447ee2a168 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40922024-12-19T06:04:10.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3d0c5844-6bd0-4699-9b7e-6a447ee2a168 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40932024-12-19T06:04:10.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3d0c5844-6bd0-4699-9b7e-6a447ee2a168 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40942024-12-19T06:04:11.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f947b64f-4508-4f34-b5e5-e74281ed8f0b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40952024-12-19T06:04:11.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f947b64f-4508-4f34-b5e5-e74281ed8f0b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40962024-12-19T06:04:11.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f947b64f-4508-4f34-b5e5-e74281ed8f0b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40972024-12-19T06:04:12.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ed41645d-5d9e-4224-adb1-7f151ac6dc16 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40982024-12-19T06:04:12.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ed41645d-5d9e-4224-adb1-7f151ac6dc16 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
40992024-12-19T06:04:12.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ed41645d-5d9e-4224-adb1-7f151ac6dc16 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41002024-12-19T06:04:13.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f822958b-f8e9-4942-9f70-e66fa626da42 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41012024-12-19T06:04:13.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f822958b-f8e9-4942-9f70-e66fa626da42 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41022024-12-19T06:04:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f822958b-f8e9-4942-9f70-e66fa626da42 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41032024-12-19T06:04:14.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c806751b-391e-41ba-9259-33628918ee4a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41042024-12-19T06:04:14.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c806751b-391e-41ba-9259-33628918ee4a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41052024-12-19T06:04:14.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c806751b-391e-41ba-9259-33628918ee4a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41062024-12-19T06:04:14.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 443 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 62dcbc0f-9f7a-4957-af37-77eba8bec7b1 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
41072024-12-19T06:04:15.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2321326a-bd40-417f-b388-47bd50a3644d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41082024-12-19T06:04:15.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2321326a-bd40-417f-b388-47bd50a3644d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41092024-12-19T06:04:15.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2321326a-bd40-417f-b388-47bd50a3644d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41102024-12-19T06:04:16.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f7c0e0ad-290f-4e7b-a852-4932b40906f4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41112024-12-19T06:04:16.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f7c0e0ad-290f-4e7b-a852-4932b40906f4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41122024-12-19T06:04:16.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f7c0e0ad-290f-4e7b-a852-4932b40906f4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41132024-12-19T06:04:17.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2409a1a5-cf2a-4830-87da-2cfc59b94966 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41142024-12-19T06:04:17.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2409a1a5-cf2a-4830-87da-2cfc59b94966 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41152024-12-19T06:04:17.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2409a1a5-cf2a-4830-87da-2cfc59b94966 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41162024-12-19T06:04:18.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 450e570f-5721-48e9-9f47-532f1aafcdab roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41172024-12-19T06:04:18.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 450e570f-5721-48e9-9f47-532f1aafcdab resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41182024-12-19T06:04:18.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 450e570f-5721-48e9-9f47-532f1aafcdab response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41192024-12-19T06:04:18.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
41202024-12-19T06:04:18.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
41212024-12-19T06:04:18.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41222024-12-19T06:04:18.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41232024-12-19T06:04:18.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41242024-12-19T06:04:18.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41252024-12-19T06:04:18.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41262024-12-19T06:04:18.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41272024-12-19T06:04:18.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41282024-12-19T06:04:18.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41292024-12-19T06:04:18.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41302024-12-19T06:04:18.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41312024-12-19T06:04:18.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41322024-12-19T06:04:18.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41332024-12-19T06:04:18.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41342024-12-19T06:04:18.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
41352024-12-19T06:04:18.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41362024-12-19T06:04:18.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41372024-12-19T06:04:18.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
41382024-12-19T06:04:18.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.049438ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
41392024-12-19T06:04:18.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.239554ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41402024-12-19T06:04:19.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0ddca981-0160-4e33-8afa-a4f1952c11a5 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41412024-12-19T06:04:19.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0ddca981-0160-4e33-8afa-a4f1952c11a5 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41422024-12-19T06:04:19.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0ddca981-0160-4e33-8afa-a4f1952c11a5 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41432024-12-19T06:04:20.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c186dc8c-693f-42e7-86c8-a8f4b779495e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41442024-12-19T06:04:20.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c186dc8c-693f-42e7-86c8-a8f4b779495e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41452024-12-19T06:04:20.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c186dc8c-693f-42e7-86c8-a8f4b779495e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41462024-12-19T06:04:21.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec32ff0c-d258-4e30-b51c-b0044f978f20 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41472024-12-19T06:04:21.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec32ff0c-d258-4e30-b51c-b0044f978f20 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41482024-12-19T06:04:21.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec32ff0c-d258-4e30-b51c-b0044f978f20 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41492024-12-19T06:04:22.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 05db9366-729f-4e78-ad68-5a6656c1ecfa roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41502024-12-19T06:04:22.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 05db9366-729f-4e78-ad68-5a6656c1ecfa resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41512024-12-19T06:04:22.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 05db9366-729f-4e78-ad68-5a6656c1ecfa response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41522024-12-19T06:04:23.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ac189f18-2e03-426e-bac6-38023f394d7f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41532024-12-19T06:04:23.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ac189f18-2e03-426e-bac6-38023f394d7f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41542024-12-19T06:04:23.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ac189f18-2e03-426e-bac6-38023f394d7f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41552024-12-19T06:04:24.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a021e031-650f-40ac-b153-9c416aaf0444 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41562024-12-19T06:04:24.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a021e031-650f-40ac-b153-9c416aaf0444 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41572024-12-19T06:04:24.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a021e031-650f-40ac-b153-9c416aaf0444 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41582024-12-19T06:04:24.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 449 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = f2ed507a-6e4e-4b8c-b50f-0e1139da82bc response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
41592024-12-19T06:04:25.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c7a21e85-d340-4fd5-a430-23b05e7e8d80 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41602024-12-19T06:04:25.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c7a21e85-d340-4fd5-a430-23b05e7e8d80 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41612024-12-19T06:04:25.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c7a21e85-d340-4fd5-a430-23b05e7e8d80 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41622024-12-19T06:04:26.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a615f2f7-947d-48a2-a03d-5c81368ab889 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41632024-12-19T06:04:26.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a615f2f7-947d-48a2-a03d-5c81368ab889 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41642024-12-19T06:04:26.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a615f2f7-947d-48a2-a03d-5c81368ab889 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41652024-12-19T06:04:27.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0bbeafe-bb2e-4022-80f5-14eff7bc3985 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41662024-12-19T06:04:27.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0bbeafe-bb2e-4022-80f5-14eff7bc3985 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41672024-12-19T06:04:27.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0bbeafe-bb2e-4022-80f5-14eff7bc3985 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41682024-12-19T06:04:28.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
41692024-12-19T06:04:28.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41702024-12-19T06:04:28.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
41712024-12-19T06:04:28.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41722024-12-19T06:04:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41732024-12-19T06:04:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41742024-12-19T06:04:28.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41752024-12-19T06:04:28.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41762024-12-19T06:04:28.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41772024-12-19T06:04:28.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41782024-12-19T06:04:28.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41792024-12-19T06:04:28.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41802024-12-19T06:04:28.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41812024-12-19T06:04:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
41822024-12-19T06:04:28.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41832024-12-19T06:04:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41842024-12-19T06:04:28.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
41852024-12-19T06:04:28.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.357615ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
41862024-12-19T06:04:28.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41872024-12-19T06:04:28.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41882024-12-19T06:04:28.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.37786ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41892024-12-19T06:04:28.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 687e39b2-bb33-4736-801e-e5c5bc472b48 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41902024-12-19T06:04:28.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 687e39b2-bb33-4736-801e-e5c5bc472b48 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41912024-12-19T06:04:28.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 687e39b2-bb33-4736-801e-e5c5bc472b48 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41922024-12-19T06:04:29.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fb6b6f55-3013-4e90-adba-7de03455a2c8 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41932024-12-19T06:04:29.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fb6b6f55-3013-4e90-adba-7de03455a2c8 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41942024-12-19T06:04:29.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fb6b6f55-3013-4e90-adba-7de03455a2c8 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
41952024-12-19T06:04:29.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 3a2c833f-66d9-483c-bd45-0614b2a07270 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
41962024-12-19T06:04:29.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 3a2c833f-66d9-483c-bd45-0614b2a07270 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
41972024-12-19T06:04:29.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = 3a2c833f-66d9-483c-bd45-0614b2a07270 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
41982024-12-19T06:04:29.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = e3360a98-15cc-4a35-8a5d-8067dc36c80a roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
41992024-12-19T06:04:29.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = e3360a98-15cc-4a35-8a5d-8067dc36c80a resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
42002024-12-19T06:04:29.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = e3360a98-15cc-4a35-8a5d-8067dc36c80a response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
42012024-12-19T06:04:30.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c1037b4-31ee-4b6e-bb82-4109c6c0ee7f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42022024-12-19T06:04:30.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c1037b4-31ee-4b6e-bb82-4109c6c0ee7f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42032024-12-19T06:04:30.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c1037b4-31ee-4b6e-bb82-4109c6c0ee7f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42042024-12-19T06:04:31.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e6580675-d5f5-4d78-bb38-810dc88a8af6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42052024-12-19T06:04:31.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e6580675-d5f5-4d78-bb38-810dc88a8af6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42062024-12-19T06:04:31.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e6580675-d5f5-4d78-bb38-810dc88a8af6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42072024-12-19T06:04:33.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7de79a9c-1521-4fc9-b290-8310f3f49c6a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42082024-12-19T06:04:33.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7de79a9c-1521-4fc9-b290-8310f3f49c6a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42092024-12-19T06:04:33.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7de79a9c-1521-4fc9-b290-8310f3f49c6a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42102024-12-19T06:04:34.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0012f07d-6835-46fe-a8cc-c24c0dd15e34 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42112024-12-19T06:04:34.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0012f07d-6835-46fe-a8cc-c24c0dd15e34 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42122024-12-19T06:04:34.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0012f07d-6835-46fe-a8cc-c24c0dd15e34 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42132024-12-19T06:04:34.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 545d3f77-e85e-477a-9a64-f7ba6b08aa1d response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
42142024-12-19T06:04:35.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4b3a9cc9-7615-40d8-9436-4613d5c6f07e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42152024-12-19T06:04:35.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4b3a9cc9-7615-40d8-9436-4613d5c6f07e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42162024-12-19T06:04:35.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4b3a9cc9-7615-40d8-9436-4613d5c6f07e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42172024-12-19T06:04:36.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cf6d6ef9-7b15-4371-9b78-bc4a7bad5558 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42182024-12-19T06:04:36.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cf6d6ef9-7b15-4371-9b78-bc4a7bad5558 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42192024-12-19T06:04:36.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = cf6d6ef9-7b15-4371-9b78-bc4a7bad5558 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42202024-12-19T06:04:37.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0efc9777-7066-4adc-9d88-9979a629c5b6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42212024-12-19T06:04:37.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0efc9777-7066-4adc-9d88-9979a629c5b6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42222024-12-19T06:04:37.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0efc9777-7066-4adc-9d88-9979a629c5b6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42232024-12-19T06:04:38.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 757a89bf-6a7d-420f-8199-7d0019ba1bda roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42242024-12-19T06:04:38.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 757a89bf-6a7d-420f-8199-7d0019ba1bda resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42252024-12-19T06:04:38.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 757a89bf-6a7d-420f-8199-7d0019ba1bda response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
42262024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
42272024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42282024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
42292024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
42302024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42312024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42322024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
42332024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
42342024-12-19T06:04:38.761ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ec4c486a-8de5-4892-b4b1-13175064de2e
42352024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
42362024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.291\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e"}
42372024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
42382024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
42392024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42402024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42412024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42422024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
42432024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42442024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
42452024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42462024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
42472024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
42482024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
42492024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
42502024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42512024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
42522024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42532024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42542024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
42552024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42562024-12-19T06:04:38.761ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 05:54:38.761357535 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42572024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42582024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
42592024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42602024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
42612024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
42622024-12-19T06:04:38.761ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42632024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42642024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42652024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
42662024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42672024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
42682024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42692024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42702024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
42712024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
42722024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
42732024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42742024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
42752024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42762024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42772024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
42782024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42792024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
42802024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
42812024-12-19T06:04:38.761ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42822024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
42832024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42842024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42852024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
42862024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42872024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42882024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42892024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42902024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42912024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42922024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42932024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42942024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42952024-12-19T06:04:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42962024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42972024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42982024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42992024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43002024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43012024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43022024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43032024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43042024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43052024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43062024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43072024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43082024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43092024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43102024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43112024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43122024-12-19T06:04:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("75a56219-191b-4e5c-8eb1-d0e62e0c42f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 477890686 } })
43132024-12-19T06:04:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ecedc0eb-6c7d-4958-9fee-747c67187e55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 477897756 } })
43142024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43152024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.370944ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
43162024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43172024-12-19T06:04:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.24883ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43182024-12-19T06:04:38.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43192024-12-19T06:04:38.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202024-12-19T06:04:38.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43212024-12-19T06:04:38.765ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.933896ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43222024-12-19T06:04:38.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43232024-12-19T06:04:38.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43242024-12-19T06:04:38.767ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 482873946 } })
43252024-12-19T06:04:38.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43262024-12-19T06:04:38.767ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43272024-12-19T06:04:38.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43282024-12-19T06:04:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43292024-12-19T06:04:38.770ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.634969ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
43302024-12-19T06:04:38.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43312024-12-19T06:04:38.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43322024-12-19T06:04:38.771ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332024-12-19T06:04:38.771ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 05:54:38.761357535 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43342024-12-19T06:04:38.771ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.91744ms iteration = 12 status = {"expiration":"2024-12-19T05:54:38.761357535Z","pruned":[]}
43352024-12-19T06:04:38.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43362024-12-19T06:04:38.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43372024-12-19T06:04:38.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43382024-12-19T06:04:38.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43392024-12-19T06:04:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43402024-12-19T06:04:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43412024-12-19T06:04:38.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43422024-12-19T06:04:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43432024-12-19T06:04:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43442024-12-19T06:04:38.774ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43452024-12-19T06:04:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43462024-12-19T06:04:38.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43472024-12-19T06:04:38.776ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43482024-12-19T06:04:38.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43492024-12-19T06:04:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43502024-12-19T06:04:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43512024-12-19T06:04:38.778ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43522024-12-19T06:04:38.778ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43532024-12-19T06:04:38.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43542024-12-19T06:04:38.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43552024-12-19T06:04:38.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43562024-12-19T06:04:38.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43572024-12-19T06:04:38.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43582024-12-19T06:04:38.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43592024-12-19T06:04:38.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 495590996 } })
43602024-12-19T06:04:38.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43612024-12-19T06:04:38.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43622024-12-19T06:04:38.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43632024-12-19T06:04:38.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43642024-12-19T06:04:38.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43652024-12-19T06:04:38.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43662024-12-19T06:04:38.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43672024-12-19T06:04:38.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43682024-12-19T06:04:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43692024-12-19T06:04:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43702024-12-19T06:04:38.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43712024-12-19T06:04:38.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43722024-12-19T06:04:38.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43732024-12-19T06:04:38.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43742024-12-19T06:04:38.807ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43752024-12-19T06:04:38.807ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43762024-12-19T06:04:38.807ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.494198ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43772024-12-19T06:04:38.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43782024-12-19T06:04:38.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43792024-12-19T06:04:38.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43802024-12-19T06:04:38.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43812024-12-19T06:04:38.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.741685ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
43822024-12-19T06:04:38.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43832024-12-19T06:04:38.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43842024-12-19T06:04:38.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43852024-12-19T06:04:38.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43862024-12-19T06:04:38.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872024-12-19T06:04:38.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43882024-12-19T06:04:38.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.873808ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43892024-12-19T06:04:38.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43902024-12-19T06:04:38.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43912024-12-19T06:04:38.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43922024-12-19T06:04:38.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43932024-12-19T06:04:38.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43942024-12-19T06:04:38.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43952024-12-19T06:04:38.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.832956ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
43962024-12-19T06:04:38.820ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43972024-12-19T06:04:38.820ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43982024-12-19T06:04:38.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43992024-12-19T06:04:38.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44002024-12-19T06:04:38.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
44012024-12-19T06:04:38.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44022024-12-19T06:04:38.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44032024-12-19T06:04:38.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042024-12-19T06:04:38.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44052024-12-19T06:04:38.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44062024-12-19T06:04:38.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44072024-12-19T06:04:38.824ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44082024-12-19T06:04:38.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44092024-12-19T06:04:38.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44102024-12-19T06:04:38.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44112024-12-19T06:04:38.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44122024-12-19T06:04:38.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 541957020 } })
44132024-12-19T06:04:38.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
44142024-12-19T06:04:38.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.575933ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44152024-12-19T06:04:38.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44162024-12-19T06:04:38.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.9856ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44172024-12-19T06:04:38.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44182024-12-19T06:04:38.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44192024-12-19T06:04:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44202024-12-19T06:04:38.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44212024-12-19T06:04:38.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44222024-12-19T06:04:38.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
44232024-12-19T06:04:38.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.251354ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
44242024-12-19T06:04:38.849ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44252024-12-19T06:04:38.849ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44262024-12-19T06:04:38.849ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.836179ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44272024-12-19T06:04:38.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44282024-12-19T06:04:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44292024-12-19T06:04:38.861ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44302024-12-19T06:04:38.861ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44312024-12-19T06:04:38.861ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.920439ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44322024-12-19T06:04:38.863ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44332024-12-19T06:04:38.863ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44342024-12-19T06:04:38.863ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44352024-12-19T06:04:38.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44362024-12-19T06:04:38.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44372024-12-19T06:04:38.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44382024-12-19T06:04:38.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44392024-12-19T06:04:38.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44402024-12-19T06:04:38.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44412024-12-19T06:04:38.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44422024-12-19T06:04:38.868ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44432024-12-19T06:04:38.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.40294ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44442024-12-19T06:04:38.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44452024-12-19T06:04:38.872ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.791449ms iteration = 26 status = {"physical_disks_added":0}
44462024-12-19T06:04:38.872ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44472024-12-19T06:04:38.872ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44482024-12-19T06:04:38.872ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44492024-12-19T06:04:38.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44502024-12-19T06:04:38.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44512024-12-19T06:04:38.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 112.685861ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
44522024-12-19T06:04:38.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44532024-12-19T06:04:38.877ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44542024-12-19T06:04:38.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44552024-12-19T06:04:38.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44562024-12-19T06:04:38.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44572024-12-19T06:04:38.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44582024-12-19T06:04:38.881ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44592024-12-19T06:04:38.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
44602024-12-19T06:04:38.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44612024-12-19T06:04:38.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44622024-12-19T06:04:38.890ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.955374ms iteration = 23 status = 0
44632024-12-19T06:04:38.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44642024-12-19T06:04:38.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44652024-12-19T06:04:38.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44662024-12-19T06:04:38.898ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44672024-12-19T06:04:38.899ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abb46775-a1ed-4a07-b41a-b35ab963f7b6", "content-length": "26", "date": "Thu, 19 Dec 2024 06:04:38 GMT"} })
44682024-12-19T06:04:38.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44692024-12-19T06:04:38.900ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44702024-12-19T06:04:38.900ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44712024-12-19T06:04:38.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44722024-12-19T06:04:38.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44732024-12-19T06:04:38.901ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44742024-12-19T06:04:38.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44752024-12-19T06:04:38.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44762024-12-19T06:04:38.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44772024-12-19T06:04:38.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44782024-12-19T06:04:38.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44792024-12-19T06:04:38.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44802024-12-19T06:04:38.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44812024-12-19T06:04:38.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44822024-12-19T06:04:38.908ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44832024-12-19T06:04:38.908ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44842024-12-19T06:04:38.908ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 05:54:06.714960 UTC dns_group = internal generation = 1
44852024-12-19T06:04:38.909ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.472231ms iteration = 12 status = {"generation":1}
44862024-12-19T06:04:38.916ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44872024-12-19T06:04:38.916ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 0 version = 2
44882024-12-19T06:04:38.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44892024-12-19T06:04:38.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44902024-12-19T06:04:38.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44912024-12-19T06:04:38.918ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T05:53:28.550897Z, time_modified: 2024-12-19T05:53:28.550897Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }) }
44922024-12-19T06:04:38.919ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.67544ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]}},"default_endpoint":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44932024-12-19T06:04:38.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44942024-12-19T06:04:38.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44952024-12-19T06:04:38.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44962024-12-19T06:04:38.922ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 1 version = 2
44972024-12-19T06:04:38.922ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44982024-12-19T06:04:38.922ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 05:54:07.672295 UTC dns_group = external generation = 2
44992024-12-19T06:04:38.922ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 160.940895ms iteration = 12 status = {"generation":2}
45002024-12-19T06:04:38.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45012024-12-19T06:04:38.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45022024-12-19T06:04:38.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45032024-12-19T06:04:38.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45042024-12-19T06:04:38.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45052024-12-19T06:04:38.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45062024-12-19T06:04:38.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45072024-12-19T06:04:38.939ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45082024-12-19T06:04:38.939ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45092024-12-19T06:04:38.939ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69e48e1c-f582-4e0d-9261-da8e297dfb3c", "content-length": "26", "date": "Thu, 19 Dec 2024 06:04:38 GMT"} })
45102024-12-19T06:04:38.939ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45112024-12-19T06:04:38.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45122024-12-19T06:04:38.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45132024-12-19T06:04:38.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45142024-12-19T06:04:38.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45152024-12-19T06:04:38.953ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45162024-12-19T06:04:38.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 192.040717ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45172024-12-19T06:04:38.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
45182024-12-19T06:04:38.957ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45192024-12-19T06:04:38.957ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b18e01a5-4da4-4694-a88d-84d690b54694", "content-length": "26", "date": "Thu, 19 Dec 2024 06:04:38 GMT"} })
45202024-12-19T06:04:38.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45212024-12-19T06:04:38.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
45222024-12-19T06:04:39.019ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45232024-12-19T06:04:39.055ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45242024-12-19T06:04:39.056ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ee92c86a-937b-4532-93c5-ce993f87fa46", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45252024-12-19T06:04:39.056ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45262024-12-19T06:04:39.058ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d4497adf-8036-4775-89f2-d9a26cc2e903", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45272024-12-19T06:04:39.058ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45282024-12-19T06:04:39.059ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45292024-12-19T06:04:39.059ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 298.170366ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45302024-12-19T06:04:39.061ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45312024-12-19T06:04:39.061ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45322024-12-19T06:04:39.061ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9c58670-0802-4049-81e7-9563af4d733d", "content-length": "372", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45332024-12-19T06:04:39.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45342024-12-19T06:04:39.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45352024-12-19T06:04:39.076ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 315.36777ms iteration = 23 status = {}
45362024-12-19T06:04:39.090ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45372024-12-19T06:04:39.090ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c1e4d1b-7fe2-4d13-bc7f-c8f68ae65995", "content-length": "1", "date": "Thu, 19 Dec 2024 06:04:38 GMT"} })
45382024-12-19T06:04:39.092ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45392024-12-19T06:04:39.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45402024-12-19T06:04:39.094ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 333.305468ms iteration = 23 status = null
45412024-12-19T06:04:39.111ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45422024-12-19T06:04:39.111ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45432024-12-19T06:04:39.112ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dfa3b1c3-81e2-43aa-b110-9aaec9f10480", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45442024-12-19T06:04:39.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45452024-12-19T06:04:39.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45462024-12-19T06:04:39.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45472024-12-19T06:04:39.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45482024-12-19T06:04:39.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45492024-12-19T06:04:39.115ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "35bb6b00-2a53-4f47-aa32-70023c1da88a", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45502024-12-19T06:04:39.115ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45512024-12-19T06:04:39.117ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d9ac992b-bebe-41c0-b943-cc826772e77c", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45522024-12-19T06:04:39.117ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45532024-12-19T06:04:39.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45542024-12-19T06:04:39.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45552024-12-19T06:04:39.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d8202f35-dad4-4f22-8820-82819663e66f", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45562024-12-19T06:04:39.119ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45572024-12-19T06:04:39.121ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45582024-12-19T06:04:39.121ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 360.162873ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45592024-12-19T06:04:39.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 166da420-6841-4bca-8b7d-cab6e3f0f75a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
45602024-12-19T06:04:39.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 166da420-6841-4bca-8b7d-cab6e3f0f75a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
45612024-12-19T06:04:39.176ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45622024-12-19T06:04:39.176ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5a453b4-e153-4cb7-8c0d-03e4e0fc8ee1", "content-length": "691", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45632024-12-19T06:04:39.176ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45642024-12-19T06:04:39.176ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45652024-12-19T06:04:39.176ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45662024-12-19T06:04:39.178ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 416.800268ms iteration = 23 status = {}
45672024-12-19T06:04:39.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 166da420-6841-4bca-8b7d-cab6e3f0f75a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
45682024-12-19T06:04:39.179ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45692024-12-19T06:04:39.179ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45702024-12-19T06:04:39.187ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6ac3ca53-5d52-47b4-9139-6d7641625aae", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45712024-12-19T06:04:39.188ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 427.073759ms iteration = 23 status = {}
45722024-12-19T06:04:39.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45732024-12-19T06:04:39.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45742024-12-19T06:04:39.198ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
45752024-12-19T06:04:39.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45762024-12-19T06:04:39.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45772024-12-19T06:04:39.209ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45782024-12-19T06:04:39.209ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa35bd19-3e80-4f24-bdbd-ce92a4dc9c16", "content-length": "134", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45792024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45802024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
45812024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45822024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45832024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45842024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45852024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45862024-12-19T06:04:39.209ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45872024-12-19T06:04:39.210ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45882024-12-19T06:04:39.210ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45892024-12-19T06:04:39.210ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
45902024-12-19T06:04:39.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45912024-12-19T06:04:39.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45922024-12-19T06:04:39.212ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45932024-12-19T06:04:39.212ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbbf3180-c747-44dc-b1e9-7bac7442b49f", "content-length": "2", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45942024-12-19T06:04:39.212ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45952024-12-19T06:04:39.212ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ab7d54c-15b9-42a6-93e6-e5379bec28e5", "content-length": "52", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45962024-12-19T06:04:39.212ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
45972024-12-19T06:04:39.212ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45982024-12-19T06:04:39.306ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "036ee694-f8d9-4d1d-8899-600bb55abbea", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
45992024-12-19T06:04:39.306ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
46002024-12-19T06:04:39.306ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46012024-12-19T06:04:39.307ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0a75062-ebbb-4fad-98ba-0b8c4284e3b7", "content-length": "682", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
46022024-12-19T06:04:39.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46032024-12-19T06:04:39.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46042024-12-19T06:04:39.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46052024-12-19T06:04:39.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46062024-12-19T06:04:39.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46072024-12-19T06:04:39.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46082024-12-19T06:04:39.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46092024-12-19T06:04:39.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46102024-12-19T06:04:39.324ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 563.485673ms iteration = 23 status = {}
46112024-12-19T06:04:39.626ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46122024-12-19T06:04:39.626ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
46132024-12-19T06:04:39.656ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
46142024-12-19T06:04:39.657ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:48218
46152024-12-19T06:04:39.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48218 req_id = 430499bd-7884-4540-85ad-e974ef1a0937 roles = RoleSet { roles: {} } uri = /metrics/producers
46162024-12-19T06:04:39.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48218 req_id = 430499bd-7884-4540-85ad-e974ef1a0937 resource = Database result = Ok(()) uri = /metrics/producers
46172024-12-19T06:04:39.694ZINFOnexus: assigned collector to new producer collector_id = bf630637-78f3-4e20-a86d-c4f19712ebb4 file = nexus/src/app/oximeter.rs:76 producer_id = 1e0292d6-c327-472e-85e6-622aab78d10f
46182024-12-19T06:04:39.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37375 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48218 req_id = 430499bd-7884-4540-85ad-e974ef1a0937 response_code = 201 uri = /metrics/producers
46192024-12-19T06:04:39.694ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "430499bd-7884-4540-85ad-e974ef1a0937", "content-length": "41", "date": "Thu, 19 Dec 2024 06:04:39 GMT"} })
46202024-12-19T06:04:39.696ZDEBGnexus (producer-registration-task): registered with nexus successfully
46212024-12-19T06:04:39.696ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
46222024-12-19T06:04:40.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82b3d98b-d255-4a61-9f14-d344c71fdecf roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46232024-12-19T06:04:40.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82b3d98b-d255-4a61-9f14-d344c71fdecf resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46242024-12-19T06:04:40.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82b3d98b-d255-4a61-9f14-d344c71fdecf response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46252024-12-19T06:04:41.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df107e6f-3b59-4a57-bcbe-3176390a9473 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46262024-12-19T06:04:41.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df107e6f-3b59-4a57-bcbe-3176390a9473 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46272024-12-19T06:04:41.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = df107e6f-3b59-4a57-bcbe-3176390a9473 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46282024-12-19T06:04:42.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 625b453f-0395-43c0-ae2b-4e6e242e95b5 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46292024-12-19T06:04:42.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 625b453f-0395-43c0-ae2b-4e6e242e95b5 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46302024-12-19T06:04:42.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 625b453f-0395-43c0-ae2b-4e6e242e95b5 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46312024-12-19T06:04:43.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fff7221e-04ff-48c8-b092-fedb2e8c2a5d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46322024-12-19T06:04:43.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fff7221e-04ff-48c8-b092-fedb2e8c2a5d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46332024-12-19T06:04:43.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = fff7221e-04ff-48c8-b092-fedb2e8c2a5d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46342024-12-19T06:04:44.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2bce7336-ee39-456b-a268-8e2eb77b75d7 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46352024-12-19T06:04:44.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2bce7336-ee39-456b-a268-8e2eb77b75d7 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46362024-12-19T06:04:44.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2bce7336-ee39-456b-a268-8e2eb77b75d7 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46372024-12-19T06:04:44.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 7c5c7c74-b0b7-401f-a85e-3a252530dc8a response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
46382024-12-19T06:04:45.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2756fdbb-4aba-4977-8e8e-5909aa286164 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46392024-12-19T06:04:45.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2756fdbb-4aba-4977-8e8e-5909aa286164 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46402024-12-19T06:04:45.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2756fdbb-4aba-4977-8e8e-5909aa286164 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46412024-12-19T06:04:46.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c65a8195-fef7-4144-87d9-8d058be51514 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46422024-12-19T06:04:46.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c65a8195-fef7-4144-87d9-8d058be51514 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46432024-12-19T06:04:46.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c65a8195-fef7-4144-87d9-8d058be51514 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46442024-12-19T06:04:47.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 920717c7-11c5-447b-bd2f-2850108846ed roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46452024-12-19T06:04:47.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 920717c7-11c5-447b-bd2f-2850108846ed resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46462024-12-19T06:04:47.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 920717c7-11c5-447b-bd2f-2850108846ed response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46472024-12-19T06:04:48.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 53225ceb-3e15-410c-ad6f-5cf2db9c19d1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46482024-12-19T06:04:48.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 53225ceb-3e15-410c-ad6f-5cf2db9c19d1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46492024-12-19T06:04:48.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 53225ceb-3e15-410c-ad6f-5cf2db9c19d1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46502024-12-19T06:04:48.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
46512024-12-19T06:04:48.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
46522024-12-19T06:04:48.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46532024-12-19T06:04:48.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46542024-12-19T06:04:48.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46552024-12-19T06:04:48.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46562024-12-19T06:04:48.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46572024-12-19T06:04:48.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46582024-12-19T06:04:48.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46592024-12-19T06:04:48.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46602024-12-19T06:04:48.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46612024-12-19T06:04:48.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46622024-12-19T06:04:48.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46632024-12-19T06:04:48.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
46642024-12-19T06:04:48.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46652024-12-19T06:04:48.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46662024-12-19T06:04:48.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
46672024-12-19T06:04:48.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.056253ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
46682024-12-19T06:04:48.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46692024-12-19T06:04:48.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46702024-12-19T06:04:48.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.862724ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46712024-12-19T06:04:49.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1b71ed9a-2606-4c71-9fb7-44c343d8a885 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46722024-12-19T06:04:49.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1b71ed9a-2606-4c71-9fb7-44c343d8a885 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46732024-12-19T06:04:49.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1b71ed9a-2606-4c71-9fb7-44c343d8a885 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46742024-12-19T06:04:50.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d96c3677-37d5-420a-8aa2-70b26766d1fe roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46752024-12-19T06:04:50.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d96c3677-37d5-420a-8aa2-70b26766d1fe resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46762024-12-19T06:04:50.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d96c3677-37d5-420a-8aa2-70b26766d1fe response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46772024-12-19T06:04:51.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0126cd87-c6e6-4d66-b4ca-2c8c37c8db7e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46782024-12-19T06:04:51.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0126cd87-c6e6-4d66-b4ca-2c8c37c8db7e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46792024-12-19T06:04:51.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0126cd87-c6e6-4d66-b4ca-2c8c37c8db7e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46802024-12-19T06:04:52.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1d3c3f6f-549f-43dd-9d57-919772637cb8 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46812024-12-19T06:04:52.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1d3c3f6f-549f-43dd-9d57-919772637cb8 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46822024-12-19T06:04:52.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1d3c3f6f-549f-43dd-9d57-919772637cb8 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46832024-12-19T06:04:53.057ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ae6cbfb2-1e55-4b36-82ac-f0046da86f52 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-19T06:04:53.035454601Z }
46842024-12-19T06:04:53.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ae6cbfb2-1e55-4b36-82ac-f0046da86f52 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
46852024-12-19T06:04:53.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ae6cbfb2-1e55-4b36-82ac-f0046da86f52 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
46862024-12-19T06:04:53.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45675 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ae6cbfb2-1e55-4b36-82ac-f0046da86f52 response_code = 204 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
46872024-12-19T06:04:53.082ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 55aff9d2-8824-476e-afff-7a243abb13b1 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T06:04:53.081894187Z }
46882024-12-19T06:04:53.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 55aff9d2-8824-476e-afff-7a243abb13b1 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
46892024-12-19T06:04:53.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 55aff9d2-8824-476e-afff-7a243abb13b1 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
46902024-12-19T06:04:53.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34683 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 55aff9d2-8824-476e-afff-7a243abb13b1 response_code = 204 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
46912024-12-19T06:04:53.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0c14f5b5-1322-4a68-af8c-44d04ad754e3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46922024-12-19T06:04:53.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0c14f5b5-1322-4a68-af8c-44d04ad754e3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46932024-12-19T06:04:53.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0c14f5b5-1322-4a68-af8c-44d04ad754e3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46942024-12-19T06:04:54.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b5aa9b17-db3f-4614-a01e-9463f92a1d9e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46952024-12-19T06:04:54.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b5aa9b17-db3f-4614-a01e-9463f92a1d9e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46962024-12-19T06:04:54.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b5aa9b17-db3f-4614-a01e-9463f92a1d9e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46972024-12-19T06:04:54.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 1c1b85d5-efea-42f5-956a-6720a6e6971a response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
46982024-12-19T06:04:55.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8baad6c-d199-4b23-a5e4-1ea308fff120 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
46992024-12-19T06:04:55.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8baad6c-d199-4b23-a5e4-1ea308fff120 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47002024-12-19T06:04:55.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8baad6c-d199-4b23-a5e4-1ea308fff120 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47012024-12-19T06:04:56.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c5b1c38-f773-477f-9a91-c67f256a7665 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47022024-12-19T06:04:56.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c5b1c38-f773-477f-9a91-c67f256a7665 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47032024-12-19T06:04:56.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c5b1c38-f773-477f-9a91-c67f256a7665 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47042024-12-19T06:04:57.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e3ee57e5-04a1-4e49-bb72-16e847a015ef roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47052024-12-19T06:04:57.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e3ee57e5-04a1-4e49-bb72-16e847a015ef resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47062024-12-19T06:04:57.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e3ee57e5-04a1-4e49-bb72-16e847a015ef response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47072024-12-19T06:04:58.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1a70c7c9-4766-46ef-b599-db4209ef27a5 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47082024-12-19T06:04:58.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1a70c7c9-4766-46ef-b599-db4209ef27a5 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47092024-12-19T06:04:58.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1a70c7c9-4766-46ef-b599-db4209ef27a5 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47102024-12-19T06:04:58.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
47112024-12-19T06:04:58.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
47122024-12-19T06:04:58.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47132024-12-19T06:04:58.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47142024-12-19T06:04:58.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47152024-12-19T06:04:58.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47162024-12-19T06:04:58.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47172024-12-19T06:04:58.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47182024-12-19T06:04:58.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47192024-12-19T06:04:58.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.257887ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47202024-12-19T06:04:58.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47212024-12-19T06:04:58.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47222024-12-19T06:04:58.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47232024-12-19T06:04:58.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47242024-12-19T06:04:58.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47252024-12-19T06:04:58.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47262024-12-19T06:04:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
47272024-12-19T06:04:58.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47282024-12-19T06:04:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47292024-12-19T06:04:58.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
47302024-12-19T06:04:58.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.19684ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
47312024-12-19T06:04:59.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a0893afc-eb77-431b-8831-795b806c0c0d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47322024-12-19T06:04:59.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a0893afc-eb77-431b-8831-795b806c0c0d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47332024-12-19T06:04:59.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a0893afc-eb77-431b-8831-795b806c0c0d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47342024-12-19T06:04:59.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = c734b5ca-7d02-43bd-be97-52035f1ebbb2 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
47352024-12-19T06:04:59.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = c734b5ca-7d02-43bd-be97-52035f1ebbb2 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
47362024-12-19T06:04:59.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = c734b5ca-7d02-43bd-be97-52035f1ebbb2 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
47372024-12-19T06:04:59.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = f29928a8-46bd-4392-9504-1f6e5e0df435 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNWM2OGI0ZC1hMDg5LTRiNjktOGM4Yi1jOWEwZjI3MmI2ZTEifX0%3D
47382024-12-19T06:04:59.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = f29928a8-46bd-4392-9504-1f6e5e0df435 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNWM2OGI0ZC1hMDg5LTRiNjktOGM4Yi1jOWEwZjI3MmI2ZTEifX0%3D
47392024-12-19T06:04:59.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = f29928a8-46bd-4392-9504-1f6e5e0df435 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNWM2OGI0ZC1hMDg5LTRiNjktOGM4Yi1jOWEwZjI3MmI2ZTEifX0%3D
47402024-12-19T06:05:00.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = be1e1b0a-0497-4250-9f93-e1960ce777f1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47412024-12-19T06:05:00.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = be1e1b0a-0497-4250-9f93-e1960ce777f1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47422024-12-19T06:05:00.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = be1e1b0a-0497-4250-9f93-e1960ce777f1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47432024-12-19T06:05:01.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c8114042-6623-4cca-bade-1bab657d7b29 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47442024-12-19T06:05:01.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c8114042-6623-4cca-bade-1bab657d7b29 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47452024-12-19T06:05:01.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c8114042-6623-4cca-bade-1bab657d7b29 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47462024-12-19T06:05:02.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0887db3b-cea3-4ef1-b716-0519be04c68d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47472024-12-19T06:05:02.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0887db3b-cea3-4ef1-b716-0519be04c68d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47482024-12-19T06:05:02.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0887db3b-cea3-4ef1-b716-0519be04c68d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47492024-12-19T06:05:03.040ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bf9df33e-71ae-4951-9487-8a1832185041 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-19T06:05:03.040014869Z }
47502024-12-19T06:05:03.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bf9df33e-71ae-4951-9487-8a1832185041 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47512024-12-19T06:05:03.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bf9df33e-71ae-4951-9487-8a1832185041 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47522024-12-19T06:05:03.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11108 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bf9df33e-71ae-4951-9487-8a1832185041 response_code = 204 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47532024-12-19T06:05:03.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aae0dd2c-7025-4592-be7c-a559f625c5b6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47542024-12-19T06:05:03.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aae0dd2c-7025-4592-be7c-a559f625c5b6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47552024-12-19T06:05:03.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aae0dd2c-7025-4592-be7c-a559f625c5b6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47562024-12-19T06:05:04.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4e11c05b-5519-4ccb-8c00-4c3edb74c02c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47572024-12-19T06:05:04.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4e11c05b-5519-4ccb-8c00-4c3edb74c02c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47582024-12-19T06:05:04.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4e11c05b-5519-4ccb-8c00-4c3edb74c02c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
47592024-12-19T06:05:04.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 473 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 6e01da78-4bb2-4ab8-8bff-98bcc91ec497 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
47602024-12-19T06:05:05.482ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T06:05:05.482666602Z }
47612024-12-19T06:05:05.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47622024-12-19T06:05:05.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47632024-12-19T06:05:05.495ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_needs_update = true
47642024-12-19T06:05:05.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47652024-12-19T06:05:05.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47662024-12-19T06:05:05.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47672024-12-19T06:05:05.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47682024-12-19T06:05:05.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47692024-12-19T06:05:05.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47702024-12-19T06:05:05.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47712024-12-19T06:05:05.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47722024-12-19T06:05:05.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47732024-12-19T06:05:05.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47742024-12-19T06:05:05.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47752024-12-19T06:05:05.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47762024-12-19T06:05:05.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47772024-12-19T06:05:05.513ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 945a1a16-215d-4d44-93d6-8182ecf02bfd, lookup_type: ById(945a1a16-215d-4d44-93d6-8182ecf02bfd) }, key: e600c0bb-c184-4415-a0e5-03fbd8225e9c, lookup_type: ById(e600c0bb-c184-4415-a0e5-03fbd8225e9c) }, key: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1, lookup_type: ById(f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1) } result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47782024-12-19T06:05:05.524ZINFOnexus (dropshot_internal): starting update saga for f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T06:05:05.482666602Z }
47792024-12-19T06:05:05.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43500 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 response_code = 204 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47802024-12-19T06:05:05.526ZDEBGnexus (dropshot_internal): preparing instance-update saga for f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4193cdf7-3c3e-4bd9-b39d-e56df454f837 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47812024-12-19T06:05:05.526ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update
47822024-12-19T06:05:05.526ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 003bb778-1bc0-4150-ad29-999ba370f993 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T06:05:05.482666602Z }
47832024-12-19T06:05:05.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 003bb778-1bc0-4150-ad29-999ba370f993 roles = RoleSet { roles: {} } uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47842024-12-19T06:05:05.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 003bb778-1bc0-4150-ad29-999ba370f993 resource = Database result = Ok(()) uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47852024-12-19T06:05:05.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4333 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 003bb778-1bc0-4150-ad29-999ba370f993 response_code = 204 uri = /vmms/b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5
47862024-12-19T06:05:05.531ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1","lookup_type":{"ById":"f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1"},"parent":{"key":"e600c0bb-c184-4415-a0e5-03fbd8225e9c","lookup_type":{"ById":"e600c0bb-c184-4415-a0e5-03fbd8225e9c"},"parent":{"key":"945a1a16-215d-4d44-93d6-8182ecf02bfd","lookup_type":{"ById":"945a1a16-215d-4d44-93d6-8182ecf02bfd"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
47872024-12-19T06:05:05.531ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update
47882024-12-19T06:05:05.575ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update
47892024-12-19T06:05:05.575ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
47902024-12-19T06:05:05.575ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
47912024-12-19T06:05:05.575ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
47922024-12-19T06:05:05.580ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
47932024-12-19T06:05:05.580ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
47942024-12-19T06:05:05.583ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
47952024-12-19T06:05:05.583ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
47962024-12-19T06:05:05.590ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
47972024-12-19T06:05:05.590ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("86cbe88a-52ce-43d5-b4ee-deffff9f7f95")) node_id = 0 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
47982024-12-19T06:05:05.595ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
47992024-12-19T06:05:05.595ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
48002024-12-19T06:05:05.608ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update
48012024-12-19T06:05:05.611ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48022024-12-19T06:05:05.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48032024-12-19T06:05:05.613ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48042024-12-19T06:05:05.613ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48052024-12-19T06:05:05.614ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48062024-12-19T06:05:05.615ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48072024-12-19T06:05:05.617ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48082024-12-19T06:05:05.617ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48092024-12-19T06:05:05.618ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48102024-12-19T06:05:05.618ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48112024-12-19T06:05:05.620ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48122024-12-19T06:05:05.620ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48132024-12-19T06:05:05.622ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48142024-12-19T06:05:05.625ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 945a1a16-215d-4d44-93d6-8182ecf02bfd, lookup_type: ById(945a1a16-215d-4d44-93d6-8182ecf02bfd) }, key: e600c0bb-c184-4415-a0e5-03fbd8225e9c, lookup_type: ById(e600c0bb-c184-4415-a0e5-03fbd8225e9c) }, key: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1, lookup_type: ById(f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1) } result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48152024-12-19T06:05:05.625ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance updater_id = 86cbe88a-52ce-43d5-b4ee-deffff9f7f95
48162024-12-19T06:05:05.625ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48172024-12-19T06:05:05.625ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48182024-12-19T06:05:05.637ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance updater_id = 86cbe88a-52ce-43d5-b4ee-deffff9f7f95
48192024-12-19T06:05:05.637ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48202024-12-19T06:05:05.638ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance
48212024-12-19T06:05:05.642ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 locked_gen = Generation(Generation(2)) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = LockInstance updater_id = 86cbe88a-52ce-43d5-b4ee-deffff9f7f95
48222024-12-19T06:05:05.645ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48232024-12-19T06:05:05.645ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("86cbe88a-52ce-43d5-b4ee-deffff9f7f95")}) node_id = 1 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
48242024-12-19T06:05:05.649ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48252024-12-19T06:05:05.649ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
48262024-12-19T06:05:05.660ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48272024-12-19T06:05:05.660ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48282024-12-19T06:05:05.662ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48292024-12-19T06:05:05.662ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48302024-12-19T06:05:05.663ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48312024-12-19T06:05:05.664ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48322024-12-19T06:05:05.665ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48332024-12-19T06:05:05.668ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 945a1a16-215d-4d44-93d6-8182ecf02bfd, lookup_type: ById(945a1a16-215d-4d44-93d6-8182ecf02bfd) }, key: e600c0bb-c184-4415-a0e5-03fbd8225e9c, lookup_type: ById(e600c0bb-c184-4415-a0e5-03fbd8225e9c) }, key: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1, lookup_type: ById(f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1) } result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48342024-12-19T06:05:05.668ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48352024-12-19T06:05:05.668ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48362024-12-19T06:05:05.676ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5, time_created: 2024-12-19T06:04:44.833507Z, time_deleted: None, instance_id: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1, sled_id: a9851483-adb5-4271-9f27-41db71133b55, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-19T06:05:05.482666Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-19T06:04:42.608648Z, gen: Generation(Generation(3)), propolis_id: Some(b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-19T06:05:05.676682792Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
48372024-12-19T06:05:05.676ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
48382024-12-19T06:05:05.676ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1","lookup_type":{"ById":"f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1"},"parent":{"key":"e600c0bb-c184-4415-a0e5-03fbd8225e9c","lookup_type":{"ById":"e600c0bb-c184-4415-a0e5-03fbd8225e9c"},"parent":{"key":"945a1a16-215d-4d44-93d6-8182ecf02bfd","lookup_type":{"ById":"945a1a16-215d-4d44-93d6-8182ecf02bfd"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"86cbe88a-52ce-43d5-b4ee-deffff9f7f95"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"e600c0bb-c184-4415-a0e5-03fbd8225e9c","ram_diff":1073741824},"destroy_active_vmm":"b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-19T06:05:05.676682792Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48392024-12-19T06:05:05.676ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
48402024-12-19T06:05:05.682ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
48412024-12-19T06:05:05.682ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48422024-12-19T06:05:05.682ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48432024-12-19T06:05:05.682ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48442024-12-19T06:05:05.687ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48452024-12-19T06:05:05.687ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48462024-12-19T06:05:05.690ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48472024-12-19T06:05:05.690ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48482024-12-19T06:05:05.695ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48492024-12-19T06:05:05.695ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("00e1883a-ec80-492c-b721-f120fc9461fd")) node_id = 0 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48502024-12-19T06:05:05.699ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48512024-12-19T06:05:05.699ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48522024-12-19T06:05:05.709ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 parent_lock = UpdaterLock { updater_id: 86cbe88a-52ce-43d5-b4ee-deffff9f7f95, locked_gen: Generation(Generation(2)) } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
48532024-12-19T06:05:05.709ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = BecomeUpdater
48542024-12-19T06:05:05.709ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = BecomeUpdater
48552024-12-19T06:05:05.720ZDEBGnexus (SagaExecutor): inherited lock from 86cbe88a-52ce-43d5-b4ee-deffff9f7f95 to 00e1883a-ec80-492c-b721-f120fc9461fd actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 86cbe88a-52ce-43d5-b4ee-deffff9f7f95 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = BecomeUpdater updater_id = 00e1883a-ec80-492c-b721-f120fc9461fd
48562024-12-19T06:05:05.720ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
48572024-12-19T06:05:05.720ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48582024-12-19T06:05:05.720ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("00e1883a-ec80-492c-b721-f120fc9461fd")}) node_id = 1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48592024-12-19T06:05:05.723ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48602024-12-19T06:05:05.723ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48612024-12-19T06:05:05.727ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48622024-12-19T06:05:05.727ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48632024-12-19T06:05:05.730ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48642024-12-19T06:05:05.730ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48652024-12-19T06:05:05.733ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
48662024-12-19T06:05:05.735ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1
48672024-12-19T06:05:05.737ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UpdateNetworkConfig
48682024-12-19T06:05:05.737ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UpdateNetworkConfig
48692024-12-19T06:05:05.743ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UpdateNetworkConfig
48702024-12-19T06:05:05.743ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UpdateNetworkConfig
48712024-12-19T06:05:05.748ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
48722024-12-19T06:05:05.748ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UpdateNetworkConfig
48732024-12-19T06:05:05.748ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UpdateNetworkConfig
48742024-12-19T06:05:05.750ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
48752024-12-19T06:05:05.750ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
48762024-12-19T06:05:05.750ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
48772024-12-19T06:05:05.751ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
48782024-12-19T06:05:05.753ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
48792024-12-19T06:05:05.753ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
48802024-12-19T06:05:05.753ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
48812024-12-19T06:05:05.761ZDEBGnexus: notifying dendrite of updates instance_id = Some(f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 (instance)) switch = switch0
48822024-12-19T06:05:05.762ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 478030802 } })
48832024-12-19T06:05:05.762ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
48842024-12-19T06:05:05.793ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48852024-12-19T06:05:05.793ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48862024-12-19T06:05:05.794ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2a066c2-7f31-4c8e-9273-f9231b437b23", "content-length": "26", "date": "Thu, 19 Dec 2024 06:05:05 GMT"} })
48872024-12-19T06:05:05.794ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48882024-12-19T06:05:05.794ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48892024-12-19T06:05:05.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 02f39958-4d41-4294-bfb9-6d3e71587c2d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
48902024-12-19T06:05:05.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 02f39958-4d41-4294-bfb9-6d3e71587c2d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
48912024-12-19T06:05:05.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 02f39958-4d41-4294-bfb9-6d3e71587c2d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
48922024-12-19T06:05:05.824ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
48932024-12-19T06:05:05.825ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc37130e-38df-4d59-b853-2b6a0422f1fe", "content-length": "4", "date": "Thu, 19 Dec 2024 06:05:05 GMT"} })
48942024-12-19T06:05:05.826ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48952024-12-19T06:05:05.826ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48962024-12-19T06:05:05.829ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
48972024-12-19T06:05:05.829ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
48982024-12-19T06:05:05.834ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
48992024-12-19T06:05:05.835ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
49002024-12-19T06:05:05.848ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-19T06:05:05.840037Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, time_modified: Some(2024-12-19T06:05:05.840037Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e600c0bb-c184-4415-a0e5-03fbd8225e9c, time_modified: Some(2024-12-19T06:05:05.840037Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49012024-12-19T06:05:05.848ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49022024-12-19T06:05:05.848ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49032024-12-19T06:05:05.852ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49042024-12-19T06:05:05.852ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49052024-12-19T06:05:05.856ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49062024-12-19T06:05:05.856ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UnassignOximeterProducer
49072024-12-19T06:05:05.856ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UnassignOximeterProducer
49082024-12-19T06:05:05.860ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = bf630637-78f3-4e20-a86d-c4f19712ebb4 producer_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49092024-12-19T06:05:05.860ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UnassignOximeterProducer
49102024-12-19T06:05:05.860ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = UnassignOximeterProducer
49112024-12-19T06:05:05.895ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49122024-12-19T06:05:05.897ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1
49132024-12-19T06:05:05.914ZDEBGnexus (SagaExecutor): client response oximeter-collector = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1", status: 204, headers: {"x-request-id": "879f778a-d32c-46e3-928b-7daf00e60eea", "date": "Thu, 19 Dec 2024 06:05:05 GMT"} }) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49142024-12-19T06:05:05.914ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = bf630637-78f3-4e20-a86d-c4f19712ebb4 producer_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49152024-12-19T06:05:05.916ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49162024-12-19T06:05:05.916ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49172024-12-19T06:05:05.920ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49182024-12-19T06:05:05.920ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49192024-12-19T06:05:05.923ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 lock = UpdaterLock { updater_id: 00e1883a-ec80-492c-b721-f120fc9461fd, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-19T06:05:05.676682792Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49202024-12-19T06:05:05.923ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = CommitInstanceUpdates
49212024-12-19T06:05:05.923ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = CommitInstanceUpdates
49222024-12-19T06:05:05.958ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 new_runtime = InstanceRuntimeState { time_updated: 2024-12-19T06:05:05.676682792Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49232024-12-19T06:05:05.958ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49242024-12-19T06:05:05.958ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49252024-12-19T06:05:05.958ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
49262024-12-19T06:05:05.958ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
49272024-12-19T06:05:05.958ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49282024-12-19T06:05:05.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49292024-12-19T06:05:05.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49302024-12-19T06:05:05.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49312024-12-19T06:05:05.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49322024-12-19T06:05:05.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332024-12-19T06:05:05.962ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49342024-12-19T06:05:05.962ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49352024-12-19T06:05:05.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49362024-12-19T06:05:05.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49372024-12-19T06:05:05.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49382024-12-19T06:05:05.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49392024-12-19T06:05:05.965ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49402024-12-19T06:05:05.965ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5")}) node_id = 7 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49412024-12-19T06:05:05.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49422024-12-19T06:05:05.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49432024-12-19T06:05:05.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49442024-12-19T06:05:05.968ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49452024-12-19T06:05:05.968ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49462024-12-19T06:05:05.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49472024-12-19T06:05:05.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49482024-12-19T06:05:05.971ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49492024-12-19T06:05:05.971ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49502024-12-19T06:05:05.974ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49512024-12-19T06:05:05.974ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49522024-12-19T06:05:05.977ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49532024-12-19T06:05:05.977ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ReleaseSledResources
49542024-12-19T06:05:05.977ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ReleaseSledResources
49552024-12-19T06:05:05.981ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49562024-12-19T06:05:05.981ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49572024-12-19T06:05:05.984ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49582024-12-19T06:05:05.984ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49592024-12-19T06:05:05.992ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 propolis_id = b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
49602024-12-19T06:05:05.992ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = MarkVmmDeleted
49612024-12-19T06:05:05.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = MarkVmmDeleted
49622024-12-19T06:05:06.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49632024-12-19T06:05:06.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49642024-12-19T06:05:06.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49652024-12-19T06:05:06.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49662024-12-19T06:05:06.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49672024-12-19T06:05:06.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49682024-12-19T06:05:06.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692024-12-19T06:05:06.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49702024-12-19T06:05:06.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49712024-12-19T06:05:06.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49722024-12-19T06:05:06.028ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49732024-12-19T06:05:06.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49742024-12-19T06:05:06.032ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49752024-12-19T06:05:06.032ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49762024-12-19T06:05:06.035ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49772024-12-19T06:05:06.035ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49782024-12-19T06:05:06.038ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
49792024-12-19T06:05:06.038ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
49802024-12-19T06:05:06.075ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49812024-12-19T06:05:06.075ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e86124a-1b04-426c-9fc8-3b6c317374c0", "content-length": "691", "date": "Thu, 19 Dec 2024 06:05:06 GMT"} })
49822024-12-19T06:05:06.075ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
49832024-12-19T06:05:06.075ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49842024-12-19T06:05:06.075ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49852024-12-19T06:05:06.077ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 118.496858ms iteration = 24 status = {}
49862024-12-19T06:05:06.081ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49872024-12-19T06:05:06.081ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49882024-12-19T06:05:06.081ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddfdba10-0f34-4629-abe3-a1417485b65d", "content-length": "372", "date": "Thu, 19 Dec 2024 06:05:06 GMT"} })
49892024-12-19T06:05:06.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49902024-12-19T06:05:06.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49912024-12-19T06:05:06.085ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49922024-12-19T06:05:06.085ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49932024-12-19T06:05:06.087ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49942024-12-19T06:05:06.087ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49952024-12-19T06:05:06.088ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49962024-12-19T06:05:06.089ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49972024-12-19T06:05:06.090ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49982024-12-19T06:05:06.093ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 945a1a16-215d-4d44-93d6-8182ecf02bfd, lookup_type: ById(945a1a16-215d-4d44-93d6-8182ecf02bfd) }, key: e600c0bb-c184-4415-a0e5-03fbd8225e9c, lookup_type: ById(e600c0bb-c184-4415-a0e5-03fbd8225e9c) }, key: f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1, lookup_type: ById(f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1) } result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
49992024-12-19T06:05:06.093ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
50002024-12-19T06:05:06.093ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_node = ChainSuccessorSaga
50012024-12-19T06:05:06.096ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50022024-12-19T06:05:06.096ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50032024-12-19T06:05:06.096ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cbe57f63-0e81-4267-a645-a7f760f4d9db", "date": "Thu, 19 Dec 2024 06:05:06 GMT"} })
50042024-12-19T06:05:06.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50052024-12-19T06:05:06.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50062024-12-19T06:05:06.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50072024-12-19T06:05:06.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50082024-12-19T06:05:06.101ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update
50092024-12-19T06:05:06.101ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50102024-12-19T06:05:06.101ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Signaled
50112024-12-19T06:05:06.101ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
50122024-12-19T06:05:06.101ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50132024-12-19T06:05:06.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50142024-12-19T06:05:06.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50152024-12-19T06:05:06.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50162024-12-19T06:05:06.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50172024-12-19T06:05:06.104ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50182024-12-19T06:05:06.104ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50192024-12-19T06:05:06.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50202024-12-19T06:05:06.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50212024-12-19T06:05:06.104ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50222024-12-19T06:05:06.104ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
50232024-12-19T06:05:06.105ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50242024-12-19T06:05:06.105ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50252024-12-19T06:05:06.105ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "290dbe14-ef32-42b6-9b7a-f5c1bbcff860", "date": "Thu, 19 Dec 2024 06:05:06 GMT"} })
50262024-12-19T06:05:06.106ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50272024-12-19T06:05:06.107ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50282024-12-19T06:05:06.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50292024-12-19T06:05:06.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50302024-12-19T06:05:06.107ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 149.201927ms iteration = 24 status = {}
50312024-12-19T06:05:06.108ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50322024-12-19T06:05:06.108ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
50332024-12-19T06:05:06.108ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50342024-12-19T06:05:06.108ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50352024-12-19T06:05:06.108ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 7.265734ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50362024-12-19T06:05:06.111ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50372024-12-19T06:05:06.111ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489
50382024-12-19T06:05:06.158ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50392024-12-19T06:05:06.159ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 saga_name = instance-update saga_result = SagaResult { saga_id: 4a5aa1ef-7507-438f-90f7-9dd856938489, saga_log: SagaLog { saga_id: 4a5aa1ef-7507-438f-90f7-9dd856938489, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("00e1883a-ec80-492c-b721-f120fc9461fd")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("00e1883a-ec80-492c-b721-f120fc9461fd")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b997e8fd-bde1-4b0c-86cd-b097bcf1bbd5")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("00e1883a-ec80-492c-b721-f120fc9461fd"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("00e1883a-ec80-492c-b721-f120fc9461fd")}} }) }
50402024-12-19T06:05:06.159ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 4a5aa1ef-7507-438f-90f7-9dd856938489 instance_id = f5c68b4d-a089-4b69-8c8b-c9a0f272b6e1 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update
50412024-12-19T06:05:06.159ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50422024-12-19T06:05:06.159ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
50432024-12-19T06:05:06.162ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50442024-12-19T06:05:06.162ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
50452024-12-19T06:05:06.165ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50462024-12-19T06:05:06.165ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
50472024-12-19T06:05:06.169ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50482024-12-19T06:05:06.169ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589
50492024-12-19T06:05:06.203ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update sec_id = 1e0292d6-c327-472e-85e6-622aab78d10f
50502024-12-19T06:05:06.203ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589 saga_name = start-instance-update saga_result = SagaResult { saga_id: 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589, saga_log: SagaLog { saga_id: 1b0b0b0b-29ff-47d3-8c2d-4a930c17f589, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("86cbe88a-52ce-43d5-b4ee-deffff9f7f95")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("86cbe88a-52ce-43d5-b4ee-deffff9f7f95")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("86cbe88a-52ce-43d5-b4ee-deffff9f7f95"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("86cbe88a-52ce-43d5-b4ee-deffff9f7f95")}} }) }
50512024-12-19T06:05:06.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f271a9cb-68ff-4eb2-8b70-1d1f653d1e5a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
50522024-12-19T06:05:06.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f271a9cb-68ff-4eb2-8b70-1d1f653d1e5a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
50532024-12-19T06:05:06.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f271a9cb-68ff-4eb2-8b70-1d1f653d1e5a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
50542024-12-19T06:05:07.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = deab39b2-317b-42fc-8471-899a99afa13a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
50552024-12-19T06:05:07.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = deab39b2-317b-42fc-8471-899a99afa13a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
50562024-12-19T06:05:07.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = deab39b2-317b-42fc-8471-899a99afa13a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
50572024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
50582024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50592024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
50602024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
50612024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50622024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50632024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
50642024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50652024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
50662024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50672024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
50682024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50692024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50702024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
50712024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50722024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
50732024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
50742024-12-19T06:05:08.761ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50752024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50762024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50772024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
50782024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50792024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
50802024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50812024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
50822024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50832024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
50842024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
50852024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50862024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
50872024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
50882024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50892024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
50902024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50912024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50922024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50932024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50942024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50952024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50962024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50972024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50982024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50992024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51002024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51012024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51022024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51032024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51042024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51052024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51062024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51072024-12-19T06:05:08.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51082024-12-19T06:05:08.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51092024-12-19T06:05:08.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51102024-12-19T06:05:08.764ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.514173ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51112024-12-19T06:05:08.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51122024-12-19T06:05:08.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51132024-12-19T06:05:08.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51142024-12-19T06:05:08.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51152024-12-19T06:05:08.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 483953591 } })
51162024-12-19T06:05:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51172024-12-19T06:05:08.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51182024-12-19T06:05:08.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51192024-12-19T06:05:08.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
51202024-12-19T06:05:08.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51212024-12-19T06:05:08.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51222024-12-19T06:05:08.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51232024-12-19T06:05:08.770ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 485914774 } })
51242024-12-19T06:05:08.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-12-19T06:05:08.770ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
51262024-12-19T06:05:08.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51272024-12-19T06:05:08.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51282024-12-19T06:05:08.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51292024-12-19T06:05:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51302024-12-19T06:05:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51312024-12-19T06:05:08.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51322024-12-19T06:05:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51332024-12-19T06:05:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51342024-12-19T06:05:08.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51352024-12-19T06:05:08.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51362024-12-19T06:05:08.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51372024-12-19T06:05:08.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51382024-12-19T06:05:08.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51392024-12-19T06:05:08.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51402024-12-19T06:05:08.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.934234ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51412024-12-19T06:05:08.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51422024-12-19T06:05:08.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51432024-12-19T06:05:08.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51442024-12-19T06:05:08.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51452024-12-19T06:05:08.778ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 494875383 } })
51462024-12-19T06:05:08.779ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
51472024-12-19T06:05:08.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51482024-12-19T06:05:08.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51492024-12-19T06:05:08.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51502024-12-19T06:05:08.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51512024-12-19T06:05:08.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51522024-12-19T06:05:08.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51532024-12-19T06:05:08.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51542024-12-19T06:05:08.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51552024-12-19T06:05:08.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51562024-12-19T06:05:08.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51572024-12-19T06:05:08.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
51582024-12-19T06:05:08.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51592024-12-19T06:05:08.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51602024-12-19T06:05:08.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51612024-12-19T06:05:08.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51622024-12-19T06:05:08.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632024-12-19T06:05:08.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51642024-12-19T06:05:08.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51652024-12-19T06:05:08.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51662024-12-19T06:05:08.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51672024-12-19T06:05:08.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51682024-12-19T06:05:08.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51692024-12-19T06:05:08.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51702024-12-19T06:05:08.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.597321ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
51712024-12-19T06:05:08.808ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
51722024-12-19T06:05:08.808ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.814429ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
51732024-12-19T06:05:08.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51742024-12-19T06:05:08.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51752024-12-19T06:05:08.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51762024-12-19T06:05:08.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51772024-12-19T06:05:08.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.026309ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
51782024-12-19T06:05:08.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51792024-12-19T06:05:08.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51802024-12-19T06:05:08.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51812024-12-19T06:05:08.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51822024-12-19T06:05:08.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51832024-12-19T06:05:08.816ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51842024-12-19T06:05:08.816ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51852024-12-19T06:05:08.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51862024-12-19T06:05:08.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51872024-12-19T06:05:08.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
51882024-12-19T06:05:08.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51892024-12-19T06:05:08.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51902024-12-19T06:05:08.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51912024-12-19T06:05:08.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51922024-12-19T06:05:08.820ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.262129ms iteration = 24 status = 0
51932024-12-19T06:05:08.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51942024-12-19T06:05:08.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51952024-12-19T06:05:08.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51962024-12-19T06:05:08.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51972024-12-19T06:05:08.826ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51982024-12-19T06:05:08.826ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.695244ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51992024-12-19T06:05:08.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.09039ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52002024-12-19T06:05:08.849ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52012024-12-19T06:05:08.849ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52022024-12-19T06:05:08.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52032024-12-19T06:05:08.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52042024-12-19T06:05:08.849ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52052024-12-19T06:05:08.849ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4b82061-dce0-42a1-93f1-f9be1d9e8d72", "content-length": "26", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52062024-12-19T06:05:08.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52072024-12-19T06:05:08.849ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52082024-12-19T06:05:08.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.610527ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52092024-12-19T06:05:08.851ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52102024-12-19T06:05:08.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 90.147444ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52112024-12-19T06:05:08.851ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52122024-12-19T06:05:08.851ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52132024-12-19T06:05:08.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.63425ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52142024-12-19T06:05:08.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52152024-12-19T06:05:08.851ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52162024-12-19T06:05:08.852ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a1006bd-4818-4e3a-bead-08ff6143f42d", "content-length": "26", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52172024-12-19T06:05:08.852ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52182024-12-19T06:05:08.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52192024-12-19T06:05:08.858ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
52202024-12-19T06:05:08.858ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52212024-12-19T06:05:08.858ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eec64b5-3217-4c94-84df-b43dfb78473c", "content-length": "26", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52222024-12-19T06:05:08.858ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52232024-12-19T06:05:08.859ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
52242024-12-19T06:05:08.864ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.282737ms iteration = 27 status = {"physical_disks_added":0}
52252024-12-19T06:05:08.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a72d554a-85b4-4274-b11b-7e4e6af8f3e3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
52262024-12-19T06:05:08.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a72d554a-85b4-4274-b11b-7e4e6af8f3e3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
52272024-12-19T06:05:08.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a72d554a-85b4-4274-b11b-7e4e6af8f3e3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
52282024-12-19T06:05:08.971ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52292024-12-19T06:05:08.971ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52302024-12-19T06:05:08.971ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52312024-12-19T06:05:08.972ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "32b51063-5658-48a5-840a-7f79afc1921b", "content-length": "2", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52322024-12-19T06:05:08.972ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e36e1e69-d784-4e15-9ea0-90c74087789a", "content-length": "372", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52332024-12-19T06:05:08.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52342024-12-19T06:05:08.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52352024-12-19T06:05:08.975ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52362024-12-19T06:05:08.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52372024-12-19T06:05:08.976ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.097889ms iteration = 24 status = {}
52382024-12-19T06:05:08.976ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.628607ms iteration = 24 status = null
52392024-12-19T06:05:08.978ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52402024-12-19T06:05:08.978ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "872ff5e7-951e-4203-9d8e-653880c665e1", "content-length": "691", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52412024-12-19T06:05:08.979ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52422024-12-19T06:05:08.979ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52432024-12-19T06:05:08.979ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52442024-12-19T06:05:08.981ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 220.133042ms iteration = 25 status = {}
52452024-12-19T06:05:09.014ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
52462024-12-19T06:05:09.014ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52472024-12-19T06:05:09.014ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "807f0f06-ae98-4393-9a5a-bf63a0617e8a", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52482024-12-19T06:05:09.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52492024-12-19T06:05:09.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52502024-12-19T06:05:09.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52512024-12-19T06:05:09.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52522024-12-19T06:05:09.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52532024-12-19T06:05:09.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52542024-12-19T06:05:09.023ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52552024-12-19T06:05:09.023ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52562024-12-19T06:05:09.023ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4d604513-7498-463c-831b-a66632ade86d", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52572024-12-19T06:05:09.024ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 263.440707ms iteration = 25 status = {}
52582024-12-19T06:05:09.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52592024-12-19T06:05:09.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52602024-12-19T06:05:09.041ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
52612024-12-19T06:05:09.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52622024-12-19T06:05:09.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52632024-12-19T06:05:09.050ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52642024-12-19T06:05:09.050ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2e6bc69-5540-4ba4-b3b0-28602f83e3e1", "content-length": "134", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52652024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52662024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
52672024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52682024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52692024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52702024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52712024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52722024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52732024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52742024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52752024-12-19T06:05:09.050ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
52762024-12-19T06:05:09.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52772024-12-19T06:05:09.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52782024-12-19T06:05:09.053ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52792024-12-19T06:05:09.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8230231c-2f0f-485d-9ca2-57e5c51fb028", "content-length": "2", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52802024-12-19T06:05:09.053ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52812024-12-19T06:05:09.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "97d9259f-956e-4a65-8044-1ea4cde82d82", "content-length": "52", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52822024-12-19T06:05:09.053ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
52832024-12-19T06:05:09.053ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52842024-12-19T06:05:09.159ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4ab845a9-0d65-4802-a524-f1f20fb838a0", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52852024-12-19T06:05:09.159ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
52862024-12-19T06:05:09.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52872024-12-19T06:05:09.159ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "91935fc9-7254-41ae-a107-0782e5385c98", "content-length": "682", "date": "Thu, 19 Dec 2024 06:05:08 GMT"} })
52882024-12-19T06:05:09.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52892024-12-19T06:05:09.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52902024-12-19T06:05:09.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52912024-12-19T06:05:09.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52922024-12-19T06:05:09.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52932024-12-19T06:05:09.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52942024-12-19T06:05:09.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52952024-12-19T06:05:09.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52962024-12-19T06:05:09.176ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 415.464824ms iteration = 24 status = {}
52972024-12-19T06:05:09.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3c813f4d-0142-49d6-a7c2-f719ea061963 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
52982024-12-19T06:05:09.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3c813f4d-0142-49d6-a7c2-f719ea061963 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
52992024-12-19T06:05:09.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3c813f4d-0142-49d6-a7c2-f719ea061963 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53002024-12-19T06:05:10.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85406dab-0857-4168-91d6-2787679020cb roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53012024-12-19T06:05:10.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85406dab-0857-4168-91d6-2787679020cb resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53022024-12-19T06:05:10.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85406dab-0857-4168-91d6-2787679020cb response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53032024-12-19T06:05:11.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a921f4b6-6cc0-4d45-92cf-ed102612cf1d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53042024-12-19T06:05:11.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a921f4b6-6cc0-4d45-92cf-ed102612cf1d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53052024-12-19T06:05:11.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a921f4b6-6cc0-4d45-92cf-ed102612cf1d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53062024-12-19T06:05:12.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b3f85b71-db02-4c6c-ac20-f0c1340d1cf9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53072024-12-19T06:05:12.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b3f85b71-db02-4c6c-ac20-f0c1340d1cf9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53082024-12-19T06:05:12.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b3f85b71-db02-4c6c-ac20-f0c1340d1cf9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53092024-12-19T06:05:13.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 91a470bd-6844-49c3-80c7-2e898b310cce roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53102024-12-19T06:05:13.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 91a470bd-6844-49c3-80c7-2e898b310cce resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53112024-12-19T06:05:13.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 91a470bd-6844-49c3-80c7-2e898b310cce response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53122024-12-19T06:05:14.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 496 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = f752010f-b6a2-4161-a4ed-e689cef608e9 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
53132024-12-19T06:05:15.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 896db4c7-4de8-4238-8032-ed9e6ec49227 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53142024-12-19T06:05:15.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 896db4c7-4de8-4238-8032-ed9e6ec49227 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53152024-12-19T06:05:15.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 896db4c7-4de8-4238-8032-ed9e6ec49227 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53162024-12-19T06:05:16.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 80b12393-d2e8-446f-b2f2-899504c17380 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53172024-12-19T06:05:16.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 80b12393-d2e8-446f-b2f2-899504c17380 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53182024-12-19T06:05:16.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 80b12393-d2e8-446f-b2f2-899504c17380 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53192024-12-19T06:05:17.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db0809b6-9a57-4e98-972e-6c32c8ec5605 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53202024-12-19T06:05:17.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db0809b6-9a57-4e98-972e-6c32c8ec5605 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53212024-12-19T06:05:17.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db0809b6-9a57-4e98-972e-6c32c8ec5605 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53222024-12-19T06:05:18.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6443d02-6223-4d7b-8c87-db4b38aaca9b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53232024-12-19T06:05:18.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6443d02-6223-4d7b-8c87-db4b38aaca9b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53242024-12-19T06:05:18.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b6443d02-6223-4d7b-8c87-db4b38aaca9b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53252024-12-19T06:05:18.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
53262024-12-19T06:05:18.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
53272024-12-19T06:05:18.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53282024-12-19T06:05:18.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53292024-12-19T06:05:18.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53302024-12-19T06:05:18.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53312024-12-19T06:05:18.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53322024-12-19T06:05:18.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53332024-12-19T06:05:18.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53342024-12-19T06:05:18.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.459603ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53352024-12-19T06:05:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53362024-12-19T06:05:18.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53372024-12-19T06:05:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53382024-12-19T06:05:18.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53392024-12-19T06:05:18.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53402024-12-19T06:05:18.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53412024-12-19T06:05:18.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
53422024-12-19T06:05:18.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53432024-12-19T06:05:18.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53442024-12-19T06:05:18.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
53452024-12-19T06:05:18.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.225776ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
53462024-12-19T06:05:19.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 84f341bc-fc62-4e28-adb0-b44c196182bc roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53472024-12-19T06:05:19.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 84f341bc-fc62-4e28-adb0-b44c196182bc resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53482024-12-19T06:05:19.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 84f341bc-fc62-4e28-adb0-b44c196182bc response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53492024-12-19T06:05:20.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 46f49e50-3256-44ff-9dd4-e3178c560c02 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53502024-12-19T06:05:20.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 46f49e50-3256-44ff-9dd4-e3178c560c02 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53512024-12-19T06:05:20.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 46f49e50-3256-44ff-9dd4-e3178c560c02 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53522024-12-19T06:05:21.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 074636e4-3365-49e9-9fca-db776f59fcf1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53532024-12-19T06:05:21.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 074636e4-3365-49e9-9fca-db776f59fcf1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53542024-12-19T06:05:21.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 074636e4-3365-49e9-9fca-db776f59fcf1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53552024-12-19T06:05:22.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4d685dad-9c72-4360-9932-c9539a053fe0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53562024-12-19T06:05:22.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4d685dad-9c72-4360-9932-c9539a053fe0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53572024-12-19T06:05:22.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4d685dad-9c72-4360-9932-c9539a053fe0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53582024-12-19T06:05:23.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a32148d7-8ca1-4463-894f-39c1eb3a2590 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53592024-12-19T06:05:23.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a32148d7-8ca1-4463-894f-39c1eb3a2590 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53602024-12-19T06:05:23.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a32148d7-8ca1-4463-894f-39c1eb3a2590 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53612024-12-19T06:05:24.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ed76bd15-f818-4af8-9dd7-6290ce3f99e1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53622024-12-19T06:05:24.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ed76bd15-f818-4af8-9dd7-6290ce3f99e1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53632024-12-19T06:05:24.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ed76bd15-f818-4af8-9dd7-6290ce3f99e1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53642024-12-19T06:05:24.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = bf264d4b-802c-42f3-ae20-ab16b94be909 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
53652024-12-19T06:05:25.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 207e6744-5acf-49a0-9b8f-060d76c4321d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53662024-12-19T06:05:25.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 207e6744-5acf-49a0-9b8f-060d76c4321d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53672024-12-19T06:05:25.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 207e6744-5acf-49a0-9b8f-060d76c4321d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53682024-12-19T06:05:26.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3a53d970-7d51-4c5d-97c0-9a899838ddc4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53692024-12-19T06:05:26.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3a53d970-7d51-4c5d-97c0-9a899838ddc4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53702024-12-19T06:05:26.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3a53d970-7d51-4c5d-97c0-9a899838ddc4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53712024-12-19T06:05:27.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f95a297e-b012-462c-a05b-c14b81cfd3ac roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53722024-12-19T06:05:27.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f95a297e-b012-462c-a05b-c14b81cfd3ac resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53732024-12-19T06:05:27.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f95a297e-b012-462c-a05b-c14b81cfd3ac response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53742024-12-19T06:05:28.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0321446-a45c-49c0-9504-472d502cdd82 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53752024-12-19T06:05:28.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0321446-a45c-49c0-9504-472d502cdd82 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53762024-12-19T06:05:28.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0321446-a45c-49c0-9504-472d502cdd82 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53772024-12-19T06:05:28.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
53782024-12-19T06:05:28.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
53792024-12-19T06:05:28.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53802024-12-19T06:05:28.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53812024-12-19T06:05:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53822024-12-19T06:05:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53832024-12-19T06:05:28.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53842024-12-19T06:05:28.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852024-12-19T06:05:28.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53862024-12-19T06:05:28.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.00954ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53872024-12-19T06:05:28.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53882024-12-19T06:05:28.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53892024-12-19T06:05:28.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53902024-12-19T06:05:28.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53912024-12-19T06:05:28.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53922024-12-19T06:05:28.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932024-12-19T06:05:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
53942024-12-19T06:05:28.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53952024-12-19T06:05:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53962024-12-19T06:05:28.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
53972024-12-19T06:05:28.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.953525ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
53982024-12-19T06:05:29.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3c86f211-d6f2-4d4c-9c57-f5e606674ea4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
53992024-12-19T06:05:29.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3c86f211-d6f2-4d4c-9c57-f5e606674ea4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54002024-12-19T06:05:29.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3c86f211-d6f2-4d4c-9c57-f5e606674ea4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54012024-12-19T06:05:30.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 742571b9-6310-4e36-9359-edcf5493d260 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54022024-12-19T06:05:30.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 742571b9-6310-4e36-9359-edcf5493d260 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54032024-12-19T06:05:30.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 742571b9-6310-4e36-9359-edcf5493d260 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54042024-12-19T06:05:31.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9ca8cd49-946e-4c33-a712-18e232d42152 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54052024-12-19T06:05:31.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9ca8cd49-946e-4c33-a712-18e232d42152 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54062024-12-19T06:05:31.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9ca8cd49-946e-4c33-a712-18e232d42152 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54072024-12-19T06:05:32.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0bcd842-47a1-4d0d-bdd1-a7e55cd03cb0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54082024-12-19T06:05:32.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0bcd842-47a1-4d0d-bdd1-a7e55cd03cb0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54092024-12-19T06:05:32.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c0bcd842-47a1-4d0d-bdd1-a7e55cd03cb0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54102024-12-19T06:05:33.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82635093-48cc-46d3-b509-92f1ae9d0741 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54112024-12-19T06:05:33.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82635093-48cc-46d3-b509-92f1ae9d0741 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54122024-12-19T06:05:33.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 82635093-48cc-46d3-b509-92f1ae9d0741 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54132024-12-19T06:05:34.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 150cbe95-3599-4e3c-b8d2-b6f6ad735b59 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54142024-12-19T06:05:34.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 150cbe95-3599-4e3c-b8d2-b6f6ad735b59 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54152024-12-19T06:05:34.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 150cbe95-3599-4e3c-b8d2-b6f6ad735b59 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54162024-12-19T06:05:34.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 565 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = e0692e3e-03d9-4317-9c77-79a516d4ec0c response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
54172024-12-19T06:05:35.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f06230f4-8e65-424c-9ec4-49c0e9cd1ab0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54182024-12-19T06:05:35.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f06230f4-8e65-424c-9ec4-49c0e9cd1ab0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54192024-12-19T06:05:35.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f06230f4-8e65-424c-9ec4-49c0e9cd1ab0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54202024-12-19T06:05:36.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3fad48f7-49e1-4d9f-a617-31810b5228a9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54212024-12-19T06:05:36.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3fad48f7-49e1-4d9f-a617-31810b5228a9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54222024-12-19T06:05:36.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3fad48f7-49e1-4d9f-a617-31810b5228a9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54232024-12-19T06:05:37.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c877d16-c125-4f32-a058-07be072b9fb3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54242024-12-19T06:05:37.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c877d16-c125-4f32-a058-07be072b9fb3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54252024-12-19T06:05:37.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 7c877d16-c125-4f32-a058-07be072b9fb3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54262024-12-19T06:05:38.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b3a85828-5268-4614-9221-0a8e18a66871 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54272024-12-19T06:05:38.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b3a85828-5268-4614-9221-0a8e18a66871 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54282024-12-19T06:05:38.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b3a85828-5268-4614-9221-0a8e18a66871 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
54292024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
54302024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
54312024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
54322024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54332024-12-19T06:05:38.761ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
54342024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54352024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54362024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
54372024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
54382024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
54392024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54402024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54412024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
54422024-12-19T06:05:38.761ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54432024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
54442024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54452024-12-19T06:05:38.761ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 05:55:38.761592181 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
54462024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
54472024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
54482024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54492024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
54502024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
54512024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54522024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54532024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
54542024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
54552024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54562024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
54572024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
54582024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54592024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
54602024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
54612024-12-19T06:05:38.761ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ec4c486a-8de5-4892-b4b1-13175064de2e
54622024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54632024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54642024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.37\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e"}
54652024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
54662024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
54672024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54682024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
54692024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54702024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54712024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
54722024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
54732024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
54742024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54752024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
54762024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54772024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
54782024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
54792024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
54802024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
54812024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54822024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
54832024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54842024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
54852024-12-19T06:05:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
54862024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54872024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54882024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
54892024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54902024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
54912024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54922024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54932024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
54942024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54952024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54962024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54972024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54982024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54992024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55002024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
55012024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55022024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55032024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
55042024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55052024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55062024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55072024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55082024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55092024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55102024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
55112024-12-19T06:05:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("75a56219-191b-4e5c-8eb1-d0e62e0c42f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 478462294 } })
55122024-12-19T06:05:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ecedc0eb-6c7d-4958-9fee-747c67187e55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 478471904 } })
55132024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55142024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55152024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55162024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55172024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55182024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55192024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55202024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55212024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55222024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55232024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55242024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55252024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
55262024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.20711ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
55272024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
55282024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55292024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55302024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.090265ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
55312024-12-19T06:05:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55322024-12-19T06:05:38.764ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55332024-12-19T06:05:38.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.660288ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
55342024-12-19T06:05:38.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55352024-12-19T06:05:38.765ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.885336ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55362024-12-19T06:05:38.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
55372024-12-19T06:05:38.766ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55382024-12-19T06:05:38.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55392024-12-19T06:05:38.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55402024-12-19T06:05:38.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55412024-12-19T06:05:38.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55422024-12-19T06:05:38.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55432024-12-19T06:05:38.768ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 05:55:38.761592181 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
55442024-12-19T06:05:38.768ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.068707ms iteration = 13 status = {"expiration":"2024-12-19T05:55:38.761592181Z","pruned":[]}
55452024-12-19T06:05:38.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55462024-12-19T06:05:38.769ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55472024-12-19T06:05:38.769ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55482024-12-19T06:05:38.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55492024-12-19T06:05:38.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 485126949 } })
55502024-12-19T06:05:38.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
55512024-12-19T06:05:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55522024-12-19T06:05:38.770ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.254176ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
55532024-12-19T06:05:38.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55542024-12-19T06:05:38.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55552024-12-19T06:05:38.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55562024-12-19T06:05:38.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55572024-12-19T06:05:38.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55582024-12-19T06:05:38.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55592024-12-19T06:05:38.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55602024-12-19T06:05:38.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55612024-12-19T06:05:38.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55622024-12-19T06:05:38.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55632024-12-19T06:05:38.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55642024-12-19T06:05:38.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55652024-12-19T06:05:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55662024-12-19T06:05:38.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55672024-12-19T06:05:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55682024-12-19T06:05:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55692024-12-19T06:05:38.774ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55702024-12-19T06:05:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55712024-12-19T06:05:38.775ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 491606748 } })
55722024-12-19T06:05:38.775ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
55732024-12-19T06:05:38.776ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
55742024-12-19T06:05:38.776ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
55752024-12-19T06:05:38.776ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.315402ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
55762024-12-19T06:05:38.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55772024-12-19T06:05:38.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55782024-12-19T06:05:38.778ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55792024-12-19T06:05:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55802024-12-19T06:05:38.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55812024-12-19T06:05:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55822024-12-19T06:05:38.781ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55832024-12-19T06:05:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55842024-12-19T06:05:38.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55852024-12-19T06:05:38.781ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55862024-12-19T06:05:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55872024-12-19T06:05:38.783ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55882024-12-19T06:05:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55892024-12-19T06:05:38.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55902024-12-19T06:05:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55912024-12-19T06:05:38.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55922024-12-19T06:05:38.785ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55932024-12-19T06:05:38.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55942024-12-19T06:05:38.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55952024-12-19T06:05:38.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55962024-12-19T06:05:38.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55972024-12-19T06:05:38.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55982024-12-19T06:05:38.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55992024-12-19T06:05:38.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56002024-12-19T06:05:38.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56012024-12-19T06:05:38.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56022024-12-19T06:05:38.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56032024-12-19T06:05:38.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56042024-12-19T06:05:38.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56052024-12-19T06:05:38.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56062024-12-19T06:05:38.792ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56072024-12-19T06:05:38.792ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56082024-12-19T06:05:38.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56092024-12-19T06:05:38.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56102024-12-19T06:05:38.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56112024-12-19T06:05:38.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56122024-12-19T06:05:38.796ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
56132024-12-19T06:05:38.796ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
56142024-12-19T06:05:38.796ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
56152024-12-19T06:05:38.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56162024-12-19T06:05:38.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56172024-12-19T06:05:38.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56182024-12-19T06:05:38.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56192024-12-19T06:05:38.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56202024-12-19T06:05:38.797ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56212024-12-19T06:05:38.797ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 35.517935ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56222024-12-19T06:05:38.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56232024-12-19T06:05:38.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56242024-12-19T06:05:38.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56252024-12-19T06:05:38.798ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 514522986 } })
56262024-12-19T06:05:38.798ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
56272024-12-19T06:05:38.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56282024-12-19T06:05:38.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56292024-12-19T06:05:38.799ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 38.082247ms iteration = 6 status = {"nsuccess":5}
56302024-12-19T06:05:38.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.670655ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
56312024-12-19T06:05:38.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56322024-12-19T06:05:38.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56332024-12-19T06:05:38.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56342024-12-19T06:05:38.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56352024-12-19T06:05:38.814ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56362024-12-19T06:05:38.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56372024-12-19T06:05:38.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56382024-12-19T06:05:38.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56392024-12-19T06:05:38.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56402024-12-19T06:05:38.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
56412024-12-19T06:05:38.816ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56422024-12-19T06:05:38.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56432024-12-19T06:05:38.817ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56442024-12-19T06:05:38.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56452024-12-19T06:05:38.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56462024-12-19T06:05:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56472024-12-19T06:05:38.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56482024-12-19T06:05:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56492024-12-19T06:05:38.829ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56502024-12-19T06:05:38.829ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
56512024-12-19T06:05:38.829ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.881327ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56522024-12-19T06:05:38.836ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
56532024-12-19T06:05:38.836ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
56542024-12-19T06:05:38.836ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
56552024-12-19T06:05:38.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56562024-12-19T06:05:38.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56572024-12-19T06:05:38.839ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56582024-12-19T06:05:38.839ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56592024-12-19T06:05:38.839ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 78.133817ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56602024-12-19T06:05:38.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56612024-12-19T06:05:38.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56622024-12-19T06:05:38.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56632024-12-19T06:05:38.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56642024-12-19T06:05:38.882ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56652024-12-19T06:05:38.910ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56662024-12-19T06:05:38.910ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56672024-12-19T06:05:38.910ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb4150b4-3f2e-47a5-acf4-f397faef3211", "content-length": "26", "date": "Thu, 19 Dec 2024 06:05:38 GMT"} })
56682024-12-19T06:05:38.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56692024-12-19T06:05:38.912ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56702024-12-19T06:05:38.949ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56712024-12-19T06:05:38.949ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56722024-12-19T06:05:38.949ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63bf2916-5fc2-431c-9dd2-42b6c9b1b0ec", "content-length": "26", "date": "Thu, 19 Dec 2024 06:05:38 GMT"} })
56732024-12-19T06:05:38.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56742024-12-19T06:05:38.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56752024-12-19T06:05:38.958ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
56762024-12-19T06:05:38.958ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56772024-12-19T06:05:38.958ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6be2dba6-3576-4bef-9551-2f410a34bc46", "content-length": "26", "date": "Thu, 19 Dec 2024 06:05:38 GMT"} })
56782024-12-19T06:05:38.959ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56792024-12-19T06:05:38.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
56802024-12-19T06:05:38.971ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56812024-12-19T06:05:39.040ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56822024-12-19T06:05:39.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "18448cf7-a471-4b93-9a76-16393b51808e", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56832024-12-19T06:05:39.040ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56842024-12-19T06:05:39.042ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "abd5e96e-48be-4bd4-b413-d27fff262513", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56852024-12-19T06:05:39.042ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56862024-12-19T06:05:39.043ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56872024-12-19T06:05:39.043ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 282.029486ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56882024-12-19T06:05:39.113ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56892024-12-19T06:05:39.113ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a9cc44-9442-40cb-8add-e323f59ac7a1", "content-length": "2", "date": "Thu, 19 Dec 2024 06:05:38 GMT"} })
56902024-12-19T06:05:39.115ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56912024-12-19T06:05:39.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56922024-12-19T06:05:39.120ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56932024-12-19T06:05:39.120ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56942024-12-19T06:05:39.120ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a571da31-8a01-443b-bfca-9d9d2de34805", "content-length": "372", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} })
56952024-12-19T06:05:39.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56962024-12-19T06:05:39.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56972024-12-19T06:05:39.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56982024-12-19T06:05:39.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56992024-12-19T06:05:39.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57002024-12-19T06:05:39.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57012024-12-19T06:05:39.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57022024-12-19T06:05:39.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
57032024-12-19T06:05:39.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57042024-12-19T06:05:39.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57052024-12-19T06:05:39.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57062024-12-19T06:05:39.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57072024-12-19T06:05:39.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57082024-12-19T06:05:39.130ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 368.963646ms iteration = 25 status = null
57092024-12-19T06:05:39.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57102024-12-19T06:05:39.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57112024-12-19T06:05:39.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57122024-12-19T06:05:39.145ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
57132024-12-19T06:05:39.145ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 383.434273ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
57142024-12-19T06:05:39.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 391.408789ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57152024-12-19T06:05:39.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57162024-12-19T06:05:39.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 395.092289ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57172024-12-19T06:05:39.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57182024-12-19T06:05:39.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57192024-12-19T06:05:39.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57202024-12-19T06:05:39.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57212024-12-19T06:05:39.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57222024-12-19T06:05:39.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57232024-12-19T06:05:39.162ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 400.625997ms iteration = 25 status = {}
57242024-12-19T06:05:39.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57252024-12-19T06:05:39.162ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57262024-12-19T06:05:39.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57272024-12-19T06:05:39.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 401.33083ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57282024-12-19T06:05:39.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57292024-12-19T06:05:39.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57302024-12-19T06:05:39.164ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
57312024-12-19T06:05:39.164ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
57322024-12-19T06:05:39.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57332024-12-19T06:05:39.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
57342024-12-19T06:05:39.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57352024-12-19T06:05:39.165ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
57362024-12-19T06:05:39.165ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 0 version = 2
57372024-12-19T06:05:39.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57382024-12-19T06:05:39.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57392024-12-19T06:05:39.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57402024-12-19T06:05:39.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57412024-12-19T06:05:39.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57422024-12-19T06:05:39.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57432024-12-19T06:05:39.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57442024-12-19T06:05:39.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57452024-12-19T06:05:39.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57462024-12-19T06:05:39.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57472024-12-19T06:05:39.171ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
57482024-12-19T06:05:39.171ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
57492024-12-19T06:05:39.171ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 05:54:06.714960 UTC dns_group = internal generation = 1
57502024-12-19T06:05:39.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 409.640368ms iteration = 13 status = {"generation":1}
57512024-12-19T06:05:39.175ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 1 version = 2
57522024-12-19T06:05:39.175ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
57532024-12-19T06:05:39.175ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 05:54:07.672295 UTC dns_group = external generation = 2
57542024-12-19T06:05:39.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 414.07615ms iteration = 13 status = {"generation":2}
57552024-12-19T06:05:39.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57562024-12-19T06:05:39.190ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57572024-12-19T06:05:39.190ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57582024-12-19T06:05:39.190ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "315b6c33-c7e2-49a1-aec5-6bdcbbbaba53", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} })
57592024-12-19T06:05:39.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57602024-12-19T06:05:39.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57612024-12-19T06:05:39.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57622024-12-19T06:05:39.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57632024-12-19T06:05:39.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
57642024-12-19T06:05:39.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57652024-12-19T06:05:39.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57662024-12-19T06:05:39.194ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T05:53:28.550897Z, time_modified: 2024-12-19T05:53:28.550897Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
57672024-12-19T06:05:39.194ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 432.955518ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]}},"default_endpoint":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
57682024-12-19T06:05:39.195ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 433.356151ms iteration = 25 status = 0
57692024-12-19T06:05:39.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57702024-12-19T06:05:39.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57712024-12-19T06:05:39.198ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57722024-12-19T06:05:39.198ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57732024-12-19T06:05:39.198ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "18996ecf-9512-4dd7-8562-1d92a0ad6791", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} })
57742024-12-19T06:05:39.200ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 439.322604ms iteration = 26 status = {}
57752024-12-19T06:05:39.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 441.945438ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
57762024-12-19T06:05:39.206ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57772024-12-19T06:05:39.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "50a0d2d0-3d69-42ca-93b4-f9a670774e7a", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57782024-12-19T06:05:39.207ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57792024-12-19T06:05:39.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "62149825-46c1-418a-80d3-5d024e5f66c1", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57802024-12-19T06:05:39.209ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57812024-12-19T06:05:39.210ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "92ac4721-0427-4792-a831-be9f39d08778", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57822024-12-19T06:05:39.210ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57832024-12-19T06:05:39.211ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57842024-12-19T06:05:39.211ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 449.592754ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57852024-12-19T06:05:39.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57862024-12-19T06:05:39.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57872024-12-19T06:05:39.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57882024-12-19T06:05:39.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57892024-12-19T06:05:39.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57902024-12-19T06:05:39.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57912024-12-19T06:05:39.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-12-19T06:05:39.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57932024-12-19T06:05:39.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57942024-12-19T06:05:39.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57952024-12-19T06:05:39.243ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
57962024-12-19T06:05:39.243ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 481.612036ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
57972024-12-19T06:05:39.244ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 483.215157ms iteration = 28 status = {"physical_disks_added":0}
57982024-12-19T06:05:39.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57992024-12-19T06:05:39.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58002024-12-19T06:05:39.254ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
58012024-12-19T06:05:39.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58022024-12-19T06:05:39.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58032024-12-19T06:05:39.264ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58042024-12-19T06:05:39.264ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ea22dd3-3b2b-436f-b1e7-6095f60ababe", "content-length": "134", "date": "Thu, 19 Dec 2024 06:05:38 GMT"} })
58052024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58062024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
58072024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58082024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58092024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58102024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58112024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58122024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58132024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58142024-12-19T06:05:39.264ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58152024-12-19T06:05:39.265ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
58162024-12-19T06:05:39.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58172024-12-19T06:05:39.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58182024-12-19T06:05:39.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58192024-12-19T06:05:39.268ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fe241ef-375c-4d51-bde9-510b23b0446f", "content-length": "2", "date": "Thu, 19 Dec 2024 06:05:38 GMT"} })
58202024-12-19T06:05:39.268ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58212024-12-19T06:05:39.268ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "71f126f8-af0a-49a0-b81b-1159c408f6f9", "content-length": "52", "date": "Thu, 19 Dec 2024 06:05:38 GMT"} })
58222024-12-19T06:05:39.268ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
58232024-12-19T06:05:39.268ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58242024-12-19T06:05:39.322ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58252024-12-19T06:05:39.368ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d2ee9adf-dbd5-46e3-bcf6-648649747cd3", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} })
58262024-12-19T06:05:39.368ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
58272024-12-19T06:05:39.368ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58282024-12-19T06:05:39.368ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "729cb498-90a8-4d6e-bb26-ea4683caf2e6", "content-length": "682", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} })
58292024-12-19T06:05:39.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58302024-12-19T06:05:39.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58312024-12-19T06:05:39.369ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "00cbda04-ef5c-454c-846c-a42a00fdb437", "content-length": "691", "date": "Thu, 19 Dec 2024 06:05:39 GMT"} })
58322024-12-19T06:05:39.369ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
58332024-12-19T06:05:39.369ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
58342024-12-19T06:05:39.369ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
58352024-12-19T06:05:39.370ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 608.3912ms iteration = 26 status = {}
58362024-12-19T06:05:39.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58372024-12-19T06:05:39.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58382024-12-19T06:05:39.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58392024-12-19T06:05:39.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58402024-12-19T06:05:39.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58412024-12-19T06:05:39.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58422024-12-19T06:05:39.385ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 623.683692ms iteration = 25 status = {}
58432024-12-19T06:05:39.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a130ac08-c1be-4e8f-96c5-eeee818de68e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58442024-12-19T06:05:39.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a130ac08-c1be-4e8f-96c5-eeee818de68e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58452024-12-19T06:05:39.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a130ac08-c1be-4e8f-96c5-eeee818de68e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58462024-12-19T06:05:40.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90d1dff9-cf7e-4b35-b00f-887c7a537999 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58472024-12-19T06:05:40.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90d1dff9-cf7e-4b35-b00f-887c7a537999 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58482024-12-19T06:05:40.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90d1dff9-cf7e-4b35-b00f-887c7a537999 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58492024-12-19T06:05:41.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c3a83fa1-6943-407d-a9aa-c7696a5f11fe roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58502024-12-19T06:05:41.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c3a83fa1-6943-407d-a9aa-c7696a5f11fe resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58512024-12-19T06:05:41.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c3a83fa1-6943-407d-a9aa-c7696a5f11fe response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58522024-12-19T06:05:42.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bec0982a-2ded-4a82-a849-3b92edaa8f01 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58532024-12-19T06:05:42.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bec0982a-2ded-4a82-a849-3b92edaa8f01 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58542024-12-19T06:05:42.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bec0982a-2ded-4a82-a849-3b92edaa8f01 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58552024-12-19T06:05:43.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f15a3371-1c92-4b92-a72f-7aa9f82305d5 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58562024-12-19T06:05:43.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f15a3371-1c92-4b92-a72f-7aa9f82305d5 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58572024-12-19T06:05:43.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f15a3371-1c92-4b92-a72f-7aa9f82305d5 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58582024-12-19T06:05:44.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8244586-f138-459d-b075-7885feb5b51f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58592024-12-19T06:05:44.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8244586-f138-459d-b075-7885feb5b51f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58602024-12-19T06:05:44.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e8244586-f138-459d-b075-7885feb5b51f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58612024-12-19T06:05:44.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 506 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 11b94e83-242e-4495-aee7-235cd6cf0e40 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
58622024-12-19T06:05:45.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9ac69611-7478-4248-bf1a-80c0142498d1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58632024-12-19T06:05:45.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9ac69611-7478-4248-bf1a-80c0142498d1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58642024-12-19T06:05:45.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9ac69611-7478-4248-bf1a-80c0142498d1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58652024-12-19T06:05:46.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 36044055-8677-4cb2-9182-4c7fd92af387 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58662024-12-19T06:05:46.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 36044055-8677-4cb2-9182-4c7fd92af387 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58672024-12-19T06:05:46.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 36044055-8677-4cb2-9182-4c7fd92af387 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58682024-12-19T06:05:47.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9e37835d-6ce2-469a-bc62-8cc90167e973 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58692024-12-19T06:05:47.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9e37835d-6ce2-469a-bc62-8cc90167e973 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58702024-12-19T06:05:47.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9e37835d-6ce2-469a-bc62-8cc90167e973 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58712024-12-19T06:05:48.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
58722024-12-19T06:05:48.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58732024-12-19T06:05:48.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
58742024-12-19T06:05:48.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58752024-12-19T06:05:48.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58762024-12-19T06:05:48.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58772024-12-19T06:05:48.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58782024-12-19T06:05:48.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58792024-12-19T06:05:48.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58802024-12-19T06:05:48.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58812024-12-19T06:05:48.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58822024-12-19T06:05:48.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58832024-12-19T06:05:48.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.609221ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58842024-12-19T06:05:48.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58852024-12-19T06:05:48.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58862024-12-19T06:05:48.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58872024-12-19T06:05:48.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
58882024-12-19T06:05:48.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58892024-12-19T06:05:48.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58902024-12-19T06:05:48.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
58912024-12-19T06:05:48.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.665422ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
58922024-12-19T06:05:48.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2a65364d-68a2-4d98-812d-4e79997f8728 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58932024-12-19T06:05:48.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2a65364d-68a2-4d98-812d-4e79997f8728 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58942024-12-19T06:05:48.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 2a65364d-68a2-4d98-812d-4e79997f8728 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58952024-12-19T06:05:49.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ddb44f5f-ff58-4d1b-a6cf-28d746ae0590 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58962024-12-19T06:05:49.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ddb44f5f-ff58-4d1b-a6cf-28d746ae0590 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58972024-12-19T06:05:49.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ddb44f5f-ff58-4d1b-a6cf-28d746ae0590 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58982024-12-19T06:05:50.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 41cbeaa0-36ec-40f0-a6a6-9fbd71036983 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
58992024-12-19T06:05:50.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 41cbeaa0-36ec-40f0-a6a6-9fbd71036983 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59002024-12-19T06:05:50.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 41cbeaa0-36ec-40f0-a6a6-9fbd71036983 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59012024-12-19T06:05:51.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 75d169ae-27c5-4bd7-8fbf-ab3aff7b26af roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59022024-12-19T06:05:51.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 75d169ae-27c5-4bd7-8fbf-ab3aff7b26af resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59032024-12-19T06:05:51.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 75d169ae-27c5-4bd7-8fbf-ab3aff7b26af response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59042024-12-19T06:05:52.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = abbb48fc-6149-4723-aeca-912f9f10c48d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59052024-12-19T06:05:52.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = abbb48fc-6149-4723-aeca-912f9f10c48d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59062024-12-19T06:05:52.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = abbb48fc-6149-4723-aeca-912f9f10c48d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59072024-12-19T06:05:53.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a01c012d-cfac-431f-a472-9536bf05b619 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59082024-12-19T06:05:53.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a01c012d-cfac-431f-a472-9536bf05b619 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59092024-12-19T06:05:53.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a01c012d-cfac-431f-a472-9536bf05b619 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59102024-12-19T06:05:54.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0b554a5e-78e8-447f-b39d-87dd6d0f6897 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59112024-12-19T06:05:54.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0b554a5e-78e8-447f-b39d-87dd6d0f6897 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59122024-12-19T06:05:54.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 0b554a5e-78e8-447f-b39d-87dd6d0f6897 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59132024-12-19T06:05:54.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = caafa847-9f4d-4a4a-aa50-d1f0fdc49484 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
59142024-12-19T06:05:56.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85d3c9b2-fddc-481a-a599-fd52ca970fb2 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59152024-12-19T06:05:56.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85d3c9b2-fddc-481a-a599-fd52ca970fb2 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59162024-12-19T06:05:56.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 85d3c9b2-fddc-481a-a599-fd52ca970fb2 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59172024-12-19T06:05:57.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bbdb61f6-d7f5-4111-8c2c-a454324ea226 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59182024-12-19T06:05:57.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bbdb61f6-d7f5-4111-8c2c-a454324ea226 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59192024-12-19T06:05:57.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bbdb61f6-d7f5-4111-8c2c-a454324ea226 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59202024-12-19T06:05:58.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 592f21aa-ff70-41cf-94c8-a556a21431d6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59212024-12-19T06:05:58.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 592f21aa-ff70-41cf-94c8-a556a21431d6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59222024-12-19T06:05:58.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 592f21aa-ff70-41cf-94c8-a556a21431d6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59232024-12-19T06:05:58.760ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
59242024-12-19T06:05:58.760ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
59252024-12-19T06:05:58.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59262024-12-19T06:05:58.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59272024-12-19T06:05:58.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59282024-12-19T06:05:58.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59292024-12-19T06:05:58.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59302024-12-19T06:05:58.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59312024-12-19T06:05:58.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59322024-12-19T06:05:58.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59332024-12-19T06:05:58.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59342024-12-19T06:05:58.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59352024-12-19T06:05:58.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59362024-12-19T06:05:58.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59372024-12-19T06:05:58.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59382024-12-19T06:05:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
59392024-12-19T06:05:58.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59402024-12-19T06:05:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59412024-12-19T06:05:58.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
59422024-12-19T06:05:58.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.415077ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
59432024-12-19T06:05:58.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.003889ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59442024-12-19T06:05:59.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f12c5c66-df88-4a4a-b509-0c67d37663e4 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59452024-12-19T06:05:59.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f12c5c66-df88-4a4a-b509-0c67d37663e4 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59462024-12-19T06:05:59.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f12c5c66-df88-4a4a-b509-0c67d37663e4 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59472024-12-19T06:06:00.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8e713a9f-be73-473c-a878-a56b15b55476 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59482024-12-19T06:06:00.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8e713a9f-be73-473c-a878-a56b15b55476 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59492024-12-19T06:06:00.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8e713a9f-be73-473c-a878-a56b15b55476 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59502024-12-19T06:06:01.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5f104afc-0b9d-4348-ba1d-832661571937 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59512024-12-19T06:06:01.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5f104afc-0b9d-4348-ba1d-832661571937 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59522024-12-19T06:06:01.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5f104afc-0b9d-4348-ba1d-832661571937 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59532024-12-19T06:06:02.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f872be39-6bc6-4c5e-8da8-7557366389e1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59542024-12-19T06:06:02.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f872be39-6bc6-4c5e-8da8-7557366389e1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59552024-12-19T06:06:02.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f872be39-6bc6-4c5e-8da8-7557366389e1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59562024-12-19T06:06:03.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90b4eab4-0a55-4726-b7c5-642d9697c622 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59572024-12-19T06:06:03.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90b4eab4-0a55-4726-b7c5-642d9697c622 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59582024-12-19T06:06:03.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 90b4eab4-0a55-4726-b7c5-642d9697c622 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59592024-12-19T06:06:04.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 973d647a-134a-43bc-bd75-34be23d6441c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59602024-12-19T06:06:04.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 973d647a-134a-43bc-bd75-34be23d6441c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59612024-12-19T06:06:04.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 973d647a-134a-43bc-bd75-34be23d6441c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59622024-12-19T06:06:04.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 278e8f17-28ef-4ac7-b9e2-ab986e290b13 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
59632024-12-19T06:06:05.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3dacae41-86b3-46eb-9f7a-dde0a653e5fc roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59642024-12-19T06:06:05.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3dacae41-86b3-46eb-9f7a-dde0a653e5fc resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59652024-12-19T06:06:05.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 3dacae41-86b3-46eb-9f7a-dde0a653e5fc response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59662024-12-19T06:06:06.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6ab0b0c8-9f7f-48e3-b4e5-69613c489378 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59672024-12-19T06:06:06.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6ab0b0c8-9f7f-48e3-b4e5-69613c489378 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59682024-12-19T06:06:06.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 6ab0b0c8-9f7f-48e3-b4e5-69613c489378 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59692024-12-19T06:06:07.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8469e0e8-e57e-417d-b662-d59eb6845773 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59702024-12-19T06:06:07.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8469e0e8-e57e-417d-b662-d59eb6845773 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59712024-12-19T06:06:07.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8469e0e8-e57e-417d-b662-d59eb6845773 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59722024-12-19T06:06:08.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db1fa175-ead1-4a5f-abbd-8da7408cad42 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59732024-12-19T06:06:08.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db1fa175-ead1-4a5f-abbd-8da7408cad42 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59742024-12-19T06:06:08.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = db1fa175-ead1-4a5f-abbd-8da7408cad42 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
59752024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
59762024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
59772024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59782024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59792024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
59802024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59812024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
59822024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
59832024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59842024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
59852024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
59862024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59872024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59882024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
59892024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59902024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
59912024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59922024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
59932024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59942024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
59952024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59962024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
59972024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
59982024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59992024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60002024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
60012024-12-19T06:06:08.761ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60022024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
60032024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60042024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60052024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
60062024-12-19T06:06:08.761ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60072024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60082024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
60092024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60102024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60112024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60122024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60132024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60142024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60152024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60162024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60172024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60182024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60192024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60202024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60212024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60222024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60232024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60242024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60252024-12-19T06:06:08.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60262024-12-19T06:06:08.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.942345ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
60272024-12-19T06:06:08.765ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.114353ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60282024-12-19T06:06:08.765ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 482132772 } })
60292024-12-19T06:06:08.766ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 482135482 } })
60302024-12-19T06:06:08.766ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
60312024-12-19T06:06:08.766ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
60322024-12-19T06:06:08.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60332024-12-19T06:06:08.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60342024-12-19T06:06:08.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60352024-12-19T06:06:08.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60362024-12-19T06:06:08.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60372024-12-19T06:06:08.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60382024-12-19T06:06:08.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60392024-12-19T06:06:08.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60402024-12-19T06:06:08.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60412024-12-19T06:06:08.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60422024-12-19T06:06:08.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60432024-12-19T06:06:08.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60442024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60452024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60462024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60472024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60482024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60492024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60502024-12-19T06:06:08.776ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60512024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60522024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60532024-12-19T06:06:08.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60542024-12-19T06:06:08.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60552024-12-19T06:06:08.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60562024-12-19T06:06:08.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60572024-12-19T06:06:08.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60582024-12-19T06:06:08.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60592024-12-19T06:06:08.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60602024-12-19T06:06:08.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60612024-12-19T06:06:08.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60622024-12-19T06:06:08.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60632024-12-19T06:06:08.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60642024-12-19T06:06:08.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60652024-12-19T06:06:08.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60662024-12-19T06:06:08.786ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 502469137 } })
60672024-12-19T06:06:08.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60682024-12-19T06:06:08.786ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
60692024-12-19T06:06:08.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60702024-12-19T06:06:08.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60712024-12-19T06:06:08.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60722024-12-19T06:06:08.800ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60732024-12-19T06:06:08.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60742024-12-19T06:06:08.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60752024-12-19T06:06:08.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60762024-12-19T06:06:08.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60772024-12-19T06:06:08.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60782024-12-19T06:06:08.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60792024-12-19T06:06:08.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60802024-12-19T06:06:08.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60812024-12-19T06:06:08.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60822024-12-19T06:06:08.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60832024-12-19T06:06:08.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60842024-12-19T06:06:08.817ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60852024-12-19T06:06:08.817ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.284863ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60862024-12-19T06:06:08.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.299114ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
60872024-12-19T06:06:08.822ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60882024-12-19T06:06:08.822ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60892024-12-19T06:06:08.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60902024-12-19T06:06:08.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60912024-12-19T06:06:08.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.762382ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60922024-12-19T06:06:08.859ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60932024-12-19T06:06:08.859ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60942024-12-19T06:06:08.859ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbc7fdcc-d04b-4c9d-8cb8-b5f5f49987b8", "content-length": "26", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
60952024-12-19T06:06:08.859ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60962024-12-19T06:06:08.861ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60972024-12-19T06:06:08.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60982024-12-19T06:06:08.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60992024-12-19T06:06:08.888ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61002024-12-19T06:06:08.888ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61012024-12-19T06:06:08.888ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "427b1fee-fea5-4d9b-ae1f-f548514e3955", "content-length": "372", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61022024-12-19T06:06:08.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61032024-12-19T06:06:08.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61042024-12-19T06:06:08.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61052024-12-19T06:06:08.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61062024-12-19T06:06:08.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61072024-12-19T06:06:08.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61082024-12-19T06:06:08.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61092024-12-19T06:06:08.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61102024-12-19T06:06:08.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 156.730789ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61112024-12-19T06:06:08.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 160.139329ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61122024-12-19T06:06:08.924ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 163.128505ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61132024-12-19T06:06:08.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61142024-12-19T06:06:08.930ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
61152024-12-19T06:06:08.930ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61162024-12-19T06:06:08.930ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12ae27b2-359f-4a39-b41d-0aa2d9d7349c", "content-length": "26", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61172024-12-19T06:06:08.930ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61182024-12-19T06:06:08.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61192024-12-19T06:06:08.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
61202024-12-19T06:06:08.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61212024-12-19T06:06:08.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61222024-12-19T06:06:08.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232024-12-19T06:06:08.934ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61242024-12-19T06:06:08.934ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61252024-12-19T06:06:08.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.940971ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61262024-12-19T06:06:08.935ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 174.008495ms iteration = 26 status = 0
61272024-12-19T06:06:08.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
61282024-12-19T06:06:08.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61292024-12-19T06:06:08.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61302024-12-19T06:06:08.946ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
61312024-12-19T06:06:08.946ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61322024-12-19T06:06:08.946ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "12932181-929c-4ee5-9d69-ac46a1ded374", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61332024-12-19T06:06:08.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61342024-12-19T06:06:08.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61352024-12-19T06:06:08.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61362024-12-19T06:06:08.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61372024-12-19T06:06:08.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61382024-12-19T06:06:08.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61392024-12-19T06:06:08.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61402024-12-19T06:06:08.950ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
61412024-12-19T06:06:08.950ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 188.346378ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
61422024-12-19T06:06:08.950ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61432024-12-19T06:06:08.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61442024-12-19T06:06:08.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61452024-12-19T06:06:08.951ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
61462024-12-19T06:06:08.951ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61472024-12-19T06:06:08.951ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d580bcf4-2d2e-4ec7-885d-9e841ed18817", "content-length": "26", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61482024-12-19T06:06:08.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61492024-12-19T06:06:08.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
61502024-12-19T06:06:08.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61512024-12-19T06:06:08.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61522024-12-19T06:06:08.955ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61532024-12-19T06:06:08.955ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61542024-12-19T06:06:08.956ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "192fcf74-2022-4c26-83fe-b6f008891bbe", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61552024-12-19T06:06:08.956ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
61562024-12-19T06:06:08.956ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c999468-ca89-41d1-b503-1401abb75148", "content-length": "2", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61572024-12-19T06:06:08.959ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 197.484543ms iteration = 27 status = {}
61582024-12-19T06:06:08.959ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61592024-12-19T06:06:08.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61602024-12-19T06:06:08.964ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.542905ms iteration = 26 status = null
61612024-12-19T06:06:08.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61622024-12-19T06:06:08.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61632024-12-19T06:06:08.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61642024-12-19T06:06:08.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61652024-12-19T06:06:08.997ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.977283ms iteration = 29 status = {"physical_disks_added":0}
61662024-12-19T06:06:09.014ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 252.592887ms iteration = 26 status = {}
61672024-12-19T06:06:09.059ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61682024-12-19T06:06:09.060ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ee4eee1-d2d9-425d-8d51-cfd1ac8b9de8", "content-length": "691", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61692024-12-19T06:06:09.060ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
61702024-12-19T06:06:09.060ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
61712024-12-19T06:06:09.060ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
61722024-12-19T06:06:09.060ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 299.185719ms iteration = 27 status = {}
61732024-12-19T06:06:09.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61742024-12-19T06:06:09.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61752024-12-19T06:06:09.104ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
61762024-12-19T06:06:09.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61772024-12-19T06:06:09.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61782024-12-19T06:06:09.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61792024-12-19T06:06:09.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7a9bc30-9c20-4bb8-834c-45aae7361ef6", "content-length": "134", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61802024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61812024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
61822024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61832024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61842024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61852024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61862024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61872024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61882024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61892024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61902024-12-19T06:06:09.115ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
61912024-12-19T06:06:09.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61922024-12-19T06:06:09.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61932024-12-19T06:06:09.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61942024-12-19T06:06:09.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c6e74a2-8ebb-43d1-ba45-86af4a2d411c", "content-length": "2", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61952024-12-19T06:06:09.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61962024-12-19T06:06:09.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "66366114-5c1f-4280-aef0-7507bcfdf011", "content-length": "52", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
61972024-12-19T06:06:09.118ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
61982024-12-19T06:06:09.118ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61992024-12-19T06:06:09.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "94323d32-38d9-477d-9554-6e0c682f6a93", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
62002024-12-19T06:06:09.223ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
62012024-12-19T06:06:09.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62022024-12-19T06:06:09.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "421c56b6-fdcb-4ec9-86e6-644668b01c0d", "content-length": "682", "date": "Thu, 19 Dec 2024 06:06:08 GMT"} })
62032024-12-19T06:06:09.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62042024-12-19T06:06:09.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62052024-12-19T06:06:09.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62062024-12-19T06:06:09.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62072024-12-19T06:06:09.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62082024-12-19T06:06:09.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62092024-12-19T06:06:09.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62102024-12-19T06:06:09.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62112024-12-19T06:06:09.240ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 478.886038ms iteration = 26 status = {}
62122024-12-19T06:06:09.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 815dc14a-ece0-4ab9-bc31-b8d08ebb0ae1 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62132024-12-19T06:06:09.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 815dc14a-ece0-4ab9-bc31-b8d08ebb0ae1 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62142024-12-19T06:06:09.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 815dc14a-ece0-4ab9-bc31-b8d08ebb0ae1 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62152024-12-19T06:06:10.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4ded31e0-cc8d-4071-8ed7-e71e81b892da roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62162024-12-19T06:06:10.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4ded31e0-cc8d-4071-8ed7-e71e81b892da resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62172024-12-19T06:06:10.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 4ded31e0-cc8d-4071-8ed7-e71e81b892da response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62182024-12-19T06:06:11.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 06908d25-cea8-4a0b-b0b0-f6c02ca838b3 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62192024-12-19T06:06:11.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 06908d25-cea8-4a0b-b0b0-f6c02ca838b3 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62202024-12-19T06:06:11.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 06908d25-cea8-4a0b-b0b0-f6c02ca838b3 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62212024-12-19T06:06:12.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39953b1c-9c8f-4c70-ab26-535f3475dde0 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62222024-12-19T06:06:12.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39953b1c-9c8f-4c70-ab26-535f3475dde0 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62232024-12-19T06:06:12.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 39953b1c-9c8f-4c70-ab26-535f3475dde0 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62242024-12-19T06:06:13.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1cb117a1-376c-4c3d-a3fa-0e1ea074661b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62252024-12-19T06:06:13.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1cb117a1-376c-4c3d-a3fa-0e1ea074661b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62262024-12-19T06:06:13.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1cb117a1-376c-4c3d-a3fa-0e1ea074661b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62272024-12-19T06:06:14.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 074bd736-f385-42b7-a5c3-cae9d7908b8b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62282024-12-19T06:06:14.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 074bd736-f385-42b7-a5c3-cae9d7908b8b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62292024-12-19T06:06:14.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 074bd736-f385-42b7-a5c3-cae9d7908b8b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62302024-12-19T06:06:14.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = b8c9216c-8adc-4a1a-802a-a5bc2ab77727 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
62312024-12-19T06:06:14.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = b8c9216c-8adc-4a1a-802a-a5bc2ab77727 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
62322024-12-19T06:06:14.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = b8c9216c-8adc-4a1a-802a-a5bc2ab77727 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?sort_by=id_ascending
62332024-12-19T06:06:14.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = c789e4b9-0072-4b5b-810e-aa0c5dfa22d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
62342024-12-19T06:06:14.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = c789e4b9-0072-4b5b-810e-aa0c5dfa22d3 resource = Database result = Ok(()) uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
62352024-12-19T06:06:14.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51990 req_id = c789e4b9-0072-4b5b-810e-aa0c5dfa22d3 response_code = 200 uri = /metrics/collectors/bf630637-78f3-4e20-a86d-c4f19712ebb4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMGY4NDQ5ZS02MTA1LTQ1MDYtOTA2My1iNDliOWYxOThhNmUifX0%3D
62362024-12-19T06:06:14.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 1d2c9ee9-b20e-4043-8fec-f32146bc1780 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
62372024-12-19T06:06:15.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9412f591-33d6-4a6d-ac86-8e9462779228 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62382024-12-19T06:06:15.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9412f591-33d6-4a6d-ac86-8e9462779228 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62392024-12-19T06:06:15.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9412f591-33d6-4a6d-ac86-8e9462779228 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62402024-12-19T06:06:16.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = afefc8f8-4568-4331-8ea3-bbbe257ff1c7 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62412024-12-19T06:06:16.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = afefc8f8-4568-4331-8ea3-bbbe257ff1c7 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62422024-12-19T06:06:16.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = afefc8f8-4568-4331-8ea3-bbbe257ff1c7 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62432024-12-19T06:06:17.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bc6eb0e7-f668-491e-a913-3b33ee63adca roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62442024-12-19T06:06:17.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bc6eb0e7-f668-491e-a913-3b33ee63adca resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62452024-12-19T06:06:17.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bc6eb0e7-f668-491e-a913-3b33ee63adca response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62462024-12-19T06:06:18.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec853fd1-87e1-49a7-b101-6dcc6c1c725d roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62472024-12-19T06:06:18.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec853fd1-87e1-49a7-b101-6dcc6c1c725d resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62482024-12-19T06:06:18.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = ec853fd1-87e1-49a7-b101-6dcc6c1c725d response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62492024-12-19T06:06:18.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
62502024-12-19T06:06:18.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
62512024-12-19T06:06:18.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62522024-12-19T06:06:18.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62532024-12-19T06:06:18.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62542024-12-19T06:06:18.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62552024-12-19T06:06:18.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62562024-12-19T06:06:18.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62572024-12-19T06:06:18.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62582024-12-19T06:06:18.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62592024-12-19T06:06:18.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62602024-12-19T06:06:18.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62612024-12-19T06:06:18.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62622024-12-19T06:06:18.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62632024-12-19T06:06:18.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62642024-12-19T06:06:18.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
62652024-12-19T06:06:18.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62662024-12-19T06:06:18.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62672024-12-19T06:06:18.811ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
62682024-12-19T06:06:18.811ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.079753ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
62692024-12-19T06:06:18.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.391749ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62702024-12-19T06:06:19.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d9563c0f-2ec8-42e5-a63d-4c0d144e5ac2 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62712024-12-19T06:06:19.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d9563c0f-2ec8-42e5-a63d-4c0d144e5ac2 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62722024-12-19T06:06:19.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d9563c0f-2ec8-42e5-a63d-4c0d144e5ac2 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62732024-12-19T06:06:20.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 220162be-7d94-413d-9136-2c472d7f862a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62742024-12-19T06:06:20.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 220162be-7d94-413d-9136-2c472d7f862a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62752024-12-19T06:06:20.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 220162be-7d94-413d-9136-2c472d7f862a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62762024-12-19T06:06:21.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = af936533-6c1d-4a87-960e-b770b45a3f75 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62772024-12-19T06:06:21.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = af936533-6c1d-4a87-960e-b770b45a3f75 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62782024-12-19T06:06:21.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = af936533-6c1d-4a87-960e-b770b45a3f75 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62792024-12-19T06:06:22.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e9b85d7a-006d-429b-96c1-302308147eb6 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62802024-12-19T06:06:22.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e9b85d7a-006d-429b-96c1-302308147eb6 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62812024-12-19T06:06:22.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = e9b85d7a-006d-429b-96c1-302308147eb6 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62822024-12-19T06:06:23.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b5d20c5e-2942-4ace-9fe8-a15089c2632b roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62832024-12-19T06:06:23.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b5d20c5e-2942-4ace-9fe8-a15089c2632b resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62842024-12-19T06:06:23.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b5d20c5e-2942-4ace-9fe8-a15089c2632b response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62852024-12-19T06:06:24.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bac56dd6-d0a1-41b8-a6db-60c17b8f810f roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62862024-12-19T06:06:24.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bac56dd6-d0a1-41b8-a6db-60c17b8f810f resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62872024-12-19T06:06:24.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = bac56dd6-d0a1-41b8-a6db-60c17b8f810f response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62882024-12-19T06:06:24.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 00657575-3c85-4e83-b56d-8eab8e886bb6 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
62892024-12-19T06:06:25.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 59f07fdb-5774-4ce7-bef4-e9b7ce72ea91 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62902024-12-19T06:06:25.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 59f07fdb-5774-4ce7-bef4-e9b7ce72ea91 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62912024-12-19T06:06:25.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 59f07fdb-5774-4ce7-bef4-e9b7ce72ea91 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62922024-12-19T06:06:26.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c715d63c-8826-444f-9ef8-03e2d6411842 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62932024-12-19T06:06:26.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c715d63c-8826-444f-9ef8-03e2d6411842 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62942024-12-19T06:06:26.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = c715d63c-8826-444f-9ef8-03e2d6411842 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62952024-12-19T06:06:27.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8e6443c7-702d-4ef5-9f89-b73837bda535 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62962024-12-19T06:06:27.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8e6443c7-702d-4ef5-9f89-b73837bda535 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62972024-12-19T06:06:27.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8e6443c7-702d-4ef5-9f89-b73837bda535 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62982024-12-19T06:06:28.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8fb117e-8a07-4aaf-a583-9691c0d05e35 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
62992024-12-19T06:06:28.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8fb117e-8a07-4aaf-a583-9691c0d05e35 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63002024-12-19T06:06:28.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = a8fb117e-8a07-4aaf-a583-9691c0d05e35 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63012024-12-19T06:06:28.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
63022024-12-19T06:06:28.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
63032024-12-19T06:06:28.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63042024-12-19T06:06:28.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63052024-12-19T06:06:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63062024-12-19T06:06:28.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63072024-12-19T06:06:28.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63082024-12-19T06:06:28.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63092024-12-19T06:06:28.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.710202ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63102024-12-19T06:06:28.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112024-12-19T06:06:28.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63122024-12-19T06:06:28.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63132024-12-19T06:06:28.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63142024-12-19T06:06:28.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63152024-12-19T06:06:28.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63162024-12-19T06:06:28.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63172024-12-19T06:06:28.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
63182024-12-19T06:06:28.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63192024-12-19T06:06:28.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63202024-12-19T06:06:28.810ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
63212024-12-19T06:06:28.810ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.793464ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
63222024-12-19T06:06:29.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8f7d2ba3-d2e3-4824-837a-307898eda8bd roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63232024-12-19T06:06:29.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8f7d2ba3-d2e3-4824-837a-307898eda8bd resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63242024-12-19T06:06:29.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 8f7d2ba3-d2e3-4824-837a-307898eda8bd response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63252024-12-19T06:06:30.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1696598f-8abc-431e-9b36-a0aa3a0d23a8 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63262024-12-19T06:06:30.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1696598f-8abc-431e-9b36-a0aa3a0d23a8 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63272024-12-19T06:06:30.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 1696598f-8abc-431e-9b36-a0aa3a0d23a8 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63282024-12-19T06:06:31.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9124c8ae-b828-49b4-8aec-e4d92565a029 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63292024-12-19T06:06:31.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9124c8ae-b828-49b4-8aec-e4d92565a029 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63302024-12-19T06:06:31.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 9124c8ae-b828-49b4-8aec-e4d92565a029 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63312024-12-19T06:06:32.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 25ee8550-4cab-4af8-9c59-638b62d66717 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63322024-12-19T06:06:32.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 25ee8550-4cab-4af8-9c59-638b62d66717 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63332024-12-19T06:06:32.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 25ee8550-4cab-4af8-9c59-638b62d66717 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63342024-12-19T06:06:33.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 67a5f92f-685c-42fe-92b4-04d5e2750914 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63352024-12-19T06:06:33.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 67a5f92f-685c-42fe-92b4-04d5e2750914 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63362024-12-19T06:06:33.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 67a5f92f-685c-42fe-92b4-04d5e2750914 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63372024-12-19T06:06:34.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 81b9088b-c2bb-4197-92f4-8f5f71b2696c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63382024-12-19T06:06:34.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 81b9088b-c2bb-4197-92f4-8f5f71b2696c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63392024-12-19T06:06:34.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 81b9088b-c2bb-4197-92f4-8f5f71b2696c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63402024-12-19T06:06:34.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = 9d213419-4d95-40c9-8cb0-0002a137cfc6 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
63412024-12-19T06:06:35.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5fef126b-79e0-4514-aa90-e212b9a3e783 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63422024-12-19T06:06:35.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5fef126b-79e0-4514-aa90-e212b9a3e783 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63432024-12-19T06:06:35.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5fef126b-79e0-4514-aa90-e212b9a3e783 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63442024-12-19T06:06:36.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b1a8658b-06e9-4859-a540-cf50fea46437 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63452024-12-19T06:06:36.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b1a8658b-06e9-4859-a540-cf50fea46437 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63462024-12-19T06:06:36.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b1a8658b-06e9-4859-a540-cf50fea46437 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63472024-12-19T06:06:37.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aaa8284c-be1a-42f0-bfba-38b3b690b33a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63482024-12-19T06:06:37.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aaa8284c-be1a-42f0-bfba-38b3b690b33a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63492024-12-19T06:06:37.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = aaa8284c-be1a-42f0-bfba-38b3b690b33a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
63502024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
63512024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
63522024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
63532024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63542024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
63552024-12-19T06:06:38.761ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 05:56:38.761216036 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
63562024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
63572024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
63582024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
63592024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
63602024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63612024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
63622024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
63632024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63642024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
63652024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63662024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
63672024-12-19T06:06:38.761ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
63682024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
63692024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63702024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63712024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
63722024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63732024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
63742024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
63752024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
63762024-12-19T06:06:38.761ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ec4c486a-8de5-4892-b4b1-13175064de2e
63772024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.27\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e"}
63782024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
63792024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
63802024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
63812024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63822024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
63832024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63842024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63852024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
63862024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
63872024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63882024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
63892024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63902024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63912024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
63922024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
63932024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63942024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63952024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
63962024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
63972024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63982024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
63992024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
64002024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64012024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
64022024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64032024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
64042024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64052024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64062024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
64072024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64082024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
64092024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
64102024-12-19T06:06:38.761ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64112024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64122024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64132024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64142024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64152024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64162024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
64172024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
64182024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64192024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64202024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64212024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64222024-12-19T06:06:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64232024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64242024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64252024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64262024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64272024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64282024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
64292024-12-19T06:06:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("75a56219-191b-4e5c-8eb1-d0e62e0c42f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb4845ab-0600-4d61-a9f2-eb93a7cc0896.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 478346031 } })
64302024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64312024-12-19T06:06:38.762ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("32bd82c5-9132-4cc5-bc52-bbcbaeb63c0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ecedc0eb-6c7d-4958-9fee-747c67187e55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f28b01fa-a622-4300-b098-26693361bed2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 478346020 } })
64322024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64332024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64342024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64352024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64362024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64372024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64382024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
64392024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.173498ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
64402024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
64412024-12-19T06:06:38.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.385484ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
64422024-12-19T06:06:38.764ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64432024-12-19T06:06:38.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64442024-12-19T06:06:38.765ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.848314ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64452024-12-19T06:06:38.766ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.822175ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
64462024-12-19T06:06:38.766ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 05:56:38.761216036 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
64472024-12-19T06:06:38.766ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.492487ms iteration = 14 status = {"expiration":"2024-12-19T05:56:38.761216036Z","pruned":[]}
64482024-12-19T06:06:38.767ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64492024-12-19T06:06:38.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.695665ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
64502024-12-19T06:06:38.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64512024-12-19T06:06:38.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 486050039 } })
64522024-12-19T06:06:38.770ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
64532024-12-19T06:06:38.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
64542024-12-19T06:06:38.771ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64552024-12-19T06:06:38.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64562024-12-19T06:06:38.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64572024-12-19T06:06:38.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64582024-12-19T06:06:38.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64592024-12-19T06:06:38.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64602024-12-19T06:06:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64612024-12-19T06:06:38.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64622024-12-19T06:06:38.775ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 492268709 } })
64632024-12-19T06:06:38.776ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
64642024-12-19T06:06:38.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64652024-12-19T06:06:38.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64662024-12-19T06:06:38.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64672024-12-19T06:06:38.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64682024-12-19T06:06:38.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64692024-12-19T06:06:38.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64702024-12-19T06:06:38.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64712024-12-19T06:06:38.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64722024-12-19T06:06:38.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64732024-12-19T06:06:38.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64742024-12-19T06:06:38.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64752024-12-19T06:06:38.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64762024-12-19T06:06:38.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.46691ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
64772024-12-19T06:06:38.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64782024-12-19T06:06:38.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64792024-12-19T06:06:38.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64802024-12-19T06:06:38.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64812024-12-19T06:06:38.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64822024-12-19T06:06:38.817ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64832024-12-19T06:06:38.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64842024-12-19T06:06:38.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.984513ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64852024-12-19T06:06:38.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64862024-12-19T06:06:38.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64872024-12-19T06:06:38.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64882024-12-19T06:06:38.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64892024-12-19T06:06:38.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64902024-12-19T06:06:38.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64912024-12-19T06:06:38.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64922024-12-19T06:06:38.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.998908ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64932024-12-19T06:06:38.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64942024-12-19T06:06:38.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64952024-12-19T06:06:38.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64962024-12-19T06:06:38.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64972024-12-19T06:06:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64982024-12-19T06:06:38.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64992024-12-19T06:06:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65002024-12-19T06:06:38.823ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65012024-12-19T06:06:38.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65022024-12-19T06:06:38.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65032024-12-19T06:06:38.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65042024-12-19T06:06:38.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65052024-12-19T06:06:38.825ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a9851483-adb5-4271-9f27-41db71133b55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 541944469 } })
65062024-12-19T06:06:38.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65072024-12-19T06:06:38.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65082024-12-19T06:06:38.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65092024-12-19T06:06:38.825ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
65102024-12-19T06:06:38.826ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65112024-12-19T06:06:38.826ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65122024-12-19T06:06:38.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65132024-12-19T06:06:38.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65142024-12-19T06:06:38.827ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
65152024-12-19T06:06:38.827ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
65162024-12-19T06:06:38.827ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 65.720208ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
65172024-12-19T06:06:38.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65182024-12-19T06:06:38.827ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65192024-12-19T06:06:38.827ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
65202024-12-19T06:06:38.827ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.016446ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
65212024-12-19T06:06:38.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65222024-12-19T06:06:38.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65232024-12-19T06:06:38.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65242024-12-19T06:06:38.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65252024-12-19T06:06:38.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65262024-12-19T06:06:38.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65272024-12-19T06:06:38.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65282024-12-19T06:06:38.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65292024-12-19T06:06:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
65302024-12-19T06:06:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65312024-12-19T06:06:38.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65322024-12-19T06:06:38.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65332024-12-19T06:06:38.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65342024-12-19T06:06:38.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65352024-12-19T06:06:38.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65362024-12-19T06:06:38.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65372024-12-19T06:06:38.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65382024-12-19T06:06:38.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65392024-12-19T06:06:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a9851483-adb5-4271-9f27-41db71133b55, lookup_type: ById(a9851483-adb5-4271-9f27-41db71133b55) } result = Ok(())
65402024-12-19T06:06:38.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65412024-12-19T06:06:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65422024-12-19T06:06:38.858ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.621623ms iteration = 27 status = 0
65432024-12-19T06:06:38.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65442024-12-19T06:06:38.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65452024-12-19T06:06:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462024-12-19T06:06:38.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65472024-12-19T06:06:38.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65482024-12-19T06:06:38.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.335955ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65492024-12-19T06:06:38.864ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65502024-12-19T06:06:38.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.125742ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65512024-12-19T06:06:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ec4c486a-8de5-4892-b4b1-13175064de2e, lookup_type: ById(ec4c486a-8de5-4892-b4b1-13175064de2e) } result = Ok(())
65522024-12-19T06:06:38.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65532024-12-19T06:06:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65542024-12-19T06:06:38.866ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65552024-12-19T06:06:38.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65562024-12-19T06:06:38.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65572024-12-19T06:06:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65582024-12-19T06:06:38.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ec4c486a-8de5-4892-b4b1-13175064de2e original_time_created = 2024-12-19 05:53:22.217622 UTC target_id = ec4c486a-8de5-4892-b4b1-13175064de2e time_created = 2024-12-19 05:53:22.217622 UTC
65592024-12-19T06:06:38.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.465793ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ec4c486a-8de5-4892-b4b1-13175064de2e","time_created":"2024-12-19T05:53:22.217622Z"}
65602024-12-19T06:06:38.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65612024-12-19T06:06:38.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65622024-12-19T06:06:38.876ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
65632024-12-19T06:06:38.876ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
65642024-12-19T06:06:38.876ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
65652024-12-19T06:06:38.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65662024-12-19T06:06:38.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65672024-12-19T06:06:38.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65682024-12-19T06:06:38.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65692024-12-19T06:06:38.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65702024-12-19T06:06:38.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65712024-12-19T06:06:38.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65722024-12-19T06:06:38.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65732024-12-19T06:06:38.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65742024-12-19T06:06:38.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65752024-12-19T06:06:38.884ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
65762024-12-19T06:06:38.885ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
65772024-12-19T06:06:38.885ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
65782024-12-19T06:06:38.885ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
65792024-12-19T06:06:38.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65802024-12-19T06:06:38.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65812024-12-19T06:06:38.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65822024-12-19T06:06:38.889ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65832024-12-19T06:06:38.889ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65842024-12-19T06:06:38.889ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8992b28c-a3d3-4297-a8df-78834d7f2de6", "content-length": "26", "date": "Thu, 19 Dec 2024 06:06:38 GMT"} })
65852024-12-19T06:06:38.889ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65862024-12-19T06:06:38.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65872024-12-19T06:06:38.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65882024-12-19T06:06:38.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65892024-12-19T06:06:38.892ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65902024-12-19T06:06:38.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.410186ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
65912024-12-19T06:06:38.897ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
65922024-12-19T06:06:38.899ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65932024-12-19T06:06:38.899ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65942024-12-19T06:06:38.899ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.214862ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65952024-12-19T06:06:38.901ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65962024-12-19T06:06:38.901ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65972024-12-19T06:06:38.901ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "106e6a7a-7baa-4a9e-acc2-7723608b29d8", "content-length": "26", "date": "Thu, 19 Dec 2024 06:06:38 GMT"} })
65982024-12-19T06:06:38.901ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65992024-12-19T06:06:38.904ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66002024-12-19T06:06:38.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66012024-12-19T06:06:38.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66022024-12-19T06:06:38.919ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66032024-12-19T06:06:38.919ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 0 version = 2
66042024-12-19T06:06:38.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66052024-12-19T06:06:38.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66062024-12-19T06:06:38.927ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.327278ms iteration = 30 status = {"physical_disks_added":0}
66072024-12-19T06:06:38.928ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T05:53:28.550897Z, time_modified: 2024-12-19T05:53:28.550897Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, db_silo: Silo { identity: SiloIdentity { id: 945a1a16-215d-4d44-93d6-8182ecf02bfd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T05:54:07.513147Z, time_modified: 2024-12-19T05:54:07.513147Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae" }] }) }
66082024-12-19T06:06:38.928ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.446345ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]}},"default_endpoint":{"silo_id":"945a1a16-215d-4d44-93d6-8182ecf02bfd","tls_certs":["807954dd5e1811dd9a9d808de8f298f4205b2ec546bd4527d6b4050a4a040dae"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
66092024-12-19T06:06:38.948ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
66102024-12-19T06:06:38.948ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 186.971994ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
66112024-12-19T06:06:38.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 97f6d54a-1e04-4b61-b39d-3e3c0beb67d8 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
66122024-12-19T06:06:38.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 97f6d54a-1e04-4b61-b39d-3e3c0beb67d8 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
66132024-12-19T06:06:38.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e zone_address = fd00:1122:3344:101::2
66142024-12-19T06:06:38.985ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66152024-12-19T06:06:38.986ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62bc5c10-94da-40d4-a211-6db8340036b5", "content-length": "26", "date": "Thu, 19 Dec 2024 06:06:38 GMT"} })
66162024-12-19T06:06:38.986ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66172024-12-19T06:06:38.987ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
66182024-12-19T06:06:39.043ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66192024-12-19T06:06:39.043ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c752e72b-fea2-43ba-afdb-edbd4a9aca3a", "content-length": "2", "date": "Thu, 19 Dec 2024 06:06:38 GMT"} })
66202024-12-19T06:06:39.044ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66212024-12-19T06:06:39.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66222024-12-19T06:06:39.064ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
66232024-12-19T06:06:39.065ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66242024-12-19T06:06:39.065ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66252024-12-19T06:06:39.066ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc9007b2-95e9-4185-86db-965f7a1e0fbb", "content-length": "372", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
66262024-12-19T06:06:39.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66272024-12-19T06:06:39.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66282024-12-19T06:06:39.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66292024-12-19T06:06:39.069ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 308.109087ms iteration = 27 status = null
66302024-12-19T06:06:39.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 97f6d54a-1e04-4b61-b39d-3e3c0beb67d8 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
66312024-12-19T06:06:39.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66322024-12-19T06:06:39.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66332024-12-19T06:06:39.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66342024-12-19T06:06:39.073ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3701a957-447c-4c62-9792-57a8c186219f dns_zone_name = oxide.test found_so_far = 1 version = 2
66352024-12-19T06:06:39.073ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
66362024-12-19T06:06:39.073ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 05:54:07.672295 UTC dns_group = external generation = 2
66372024-12-19T06:06:39.073ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 311.703092ms iteration = 14 status = {"generation":2}
66382024-12-19T06:06:39.099ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
66392024-12-19T06:06:39.099ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
66402024-12-19T06:06:39.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66412024-12-19T06:06:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66422024-12-19T06:06:39.116ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66432024-12-19T06:06:39.116ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66442024-12-19T06:06:39.116ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bedb1bb4-2dd2-4d82-bbb9-29481e70e694", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
66452024-12-19T06:06:39.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66462024-12-19T06:06:39.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66472024-12-19T06:06:39.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66482024-12-19T06:06:39.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66492024-12-19T06:06:39.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66502024-12-19T06:06:39.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66512024-12-19T06:06:39.126ZINFOnexus (BackgroundTasks): VPC route manager sled a9851483-adb5-4271-9f27-41db71133b55 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66522024-12-19T06:06:39.126ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66532024-12-19T06:06:39.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66542024-12-19T06:06:39.127ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "aa8fe590-0eb3-47a0-bcbc-f9df16fec304", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
66552024-12-19T06:06:39.128ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 367.21532ms iteration = 28 status = {}
66562024-12-19T06:06:39.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66572024-12-19T06:06:39.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66582024-12-19T06:06:39.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66592024-12-19T06:06:39.136ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c3a61d5d-c41f-4b98-bbfc-5fd694a1fe35 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
66602024-12-19T06:06:39.136ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
66612024-12-19T06:06:39.136ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 05:54:06.714960 UTC dns_group = internal generation = 1
66622024-12-19T06:06:39.136ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 374.539736ms iteration = 14 status = {"generation":1}
66632024-12-19T06:06:39.156ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
66642024-12-19T06:06:39.156ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "429d64c4-ced0-4f45-b169-6db5bbd5e191", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66652024-12-19T06:06:39.156ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66662024-12-19T06:06:39.157ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d5275163-6b34-498c-ab9e-0af9c2aa1830", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66672024-12-19T06:06:39.157ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66682024-12-19T06:06:39.159ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66692024-12-19T06:06:39.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 397.846577ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
66702024-12-19T06:06:39.165ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 404.191231ms iteration = 27 status = {}
66712024-12-19T06:06:39.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66722024-12-19T06:06:39.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66732024-12-19T06:06:39.174ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
66742024-12-19T06:06:39.175ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e5506c58-88a2-47b6-942c-3b85ebe46cc7", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66752024-12-19T06:06:39.175ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66762024-12-19T06:06:39.177ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c8d689da-1c66-4b78-a1e9-a819504a35ff", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66772024-12-19T06:06:39.177ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66782024-12-19T06:06:39.179ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e45be05c-c43a-4e16-baa4-adf78d1771d5", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66792024-12-19T06:06:39.179ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66802024-12-19T06:06:39.181ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66812024-12-19T06:06:39.181ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 419.806254ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
66822024-12-19T06:06:39.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66832024-12-19T06:06:39.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66842024-12-19T06:06:39.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66852024-12-19T06:06:39.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66862024-12-19T06:06:39.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66872024-12-19T06:06:39.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66882024-12-19T06:06:39.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66892024-12-19T06:06:39.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66902024-12-19T06:06:39.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66912024-12-19T06:06:39.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66922024-12-19T06:06:39.227ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 618a29bd-d506-4f43-a26b-cca98e26c166, rack_id: 0a0969bd-a4d0-497b-839e-e0d088b15b4e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0ca8e50b-f2c1-4b24-b19d-d49a366b591a) } rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
66932024-12-19T06:06:39.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66942024-12-19T06:06:39.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66952024-12-19T06:06:39.237ZDEBGnexus (BackgroundTasks): client request SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66962024-12-19T06:06:39.237ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66972024-12-19T06:06:39.237ZDEBGnexus (BackgroundTasks): client response SledAgent = a9851483-adb5-4271-9f27-41db71133b55 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c2ad2a3-51bc-4d83-9db6-261ab056732d", "content-length": "691", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
66982024-12-19T06:06:39.237ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66992024-12-19T06:06:39.237ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
67002024-12-19T06:06:39.237ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
67012024-12-19T06:06:39.238ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba78dcf6-6e67-4478-b7ed-cd49406058e4", "content-length": "134", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
67022024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67032024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0ca8e50b-f2c1-4b24-b19d-d49a366b591a
67042024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67052024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67062024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67072024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67082024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67092024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67102024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67112024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67122024-12-19T06:06:39.238ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 477.259986ms iteration = 28 status = {}
67132024-12-19T06:06:39.238ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e
67142024-12-19T06:06:39.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67152024-12-19T06:06:39.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67162024-12-19T06:06:39.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67172024-12-19T06:06:39.240ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a6dc4ea-9033-4dbc-ae53-258b8d90cfa2", "content-length": "2", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
67182024-12-19T06:06:39.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67192024-12-19T06:06:39.240ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aff926b2-2f02-449d-b2ee-c7fd5c8482ee", "content-length": "52", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
67202024-12-19T06:06:39.240ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch_location = Switch0
67212024-12-19T06:06:39.240ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67222024-12-19T06:06:39.336ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "deb76d0f-2615-4649-820e-8deda1ec9610", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
67232024-12-19T06:06:39.336ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e switch = Switch0
67242024-12-19T06:06:39.336ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67252024-12-19T06:06:39.336ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0a0969bd-a4d0-497b-839e-e0d088b15b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f1a474e-a857-45ab-89c2-f4a1afed5624", "content-length": "682", "date": "Thu, 19 Dec 2024 06:06:39 GMT"} })
67262024-12-19T06:06:39.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67272024-12-19T06:06:39.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67282024-12-19T06:06:39.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67292024-12-19T06:06:39.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67302024-12-19T06:06:39.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67312024-12-19T06:06:39.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67322024-12-19T06:06:39.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67332024-12-19T06:06:39.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67342024-12-19T06:06:39.352ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 590.735561ms iteration = 27 status = {}
67352024-12-19T06:06:40.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 573afab5-0091-437a-a4f9-1bf7aceb1265 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67362024-12-19T06:06:40.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 573afab5-0091-437a-a4f9-1bf7aceb1265 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67372024-12-19T06:06:40.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 573afab5-0091-437a-a4f9-1bf7aceb1265 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67382024-12-19T06:06:41.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b27e663f-0821-4d3f-83d8-770bd3bf7da9 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67392024-12-19T06:06:41.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b27e663f-0821-4d3f-83d8-770bd3bf7da9 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67402024-12-19T06:06:41.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b27e663f-0821-4d3f-83d8-770bd3bf7da9 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67412024-12-19T06:06:42.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f5fd9cc7-2198-41da-92f3-3c643da77aca roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67422024-12-19T06:06:42.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f5fd9cc7-2198-41da-92f3-3c643da77aca resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67432024-12-19T06:06:42.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = f5fd9cc7-2198-41da-92f3-3c643da77aca response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67442024-12-19T06:06:43.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5fb518ca-cdef-4caf-83f3-5775152d1e62 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67452024-12-19T06:06:43.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5fb518ca-cdef-4caf-83f3-5775152d1e62 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67462024-12-19T06:06:43.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 5fb518ca-cdef-4caf-83f3-5775152d1e62 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67472024-12-19T06:06:44.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 16d3e05b-d244-4e43-a85c-ae95f4454700 roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67482024-12-19T06:06:44.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 16d3e05b-d244-4e43-a85c-ae95f4454700 resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67492024-12-19T06:06:44.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 16d3e05b-d244-4e43-a85c-ae95f4454700 response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67502024-12-19T06:06:44.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::b]:36762 method = GET remote_addr = [fd00:1122:3344:101::d]:51756 req_id = b47ff9fa-9c0b-4b73-a8e4-32edcb590341 response_code = 200 uri = /1e0292d6-c327-472e-85e6-622aab78d10f
67512024-12-19T06:06:45.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 50b4b45e-c707-4578-9743-dde3e247483a roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67522024-12-19T06:06:45.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 50b4b45e-c707-4578-9743-dde3e247483a resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67532024-12-19T06:06:45.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = 50b4b45e-c707-4578-9743-dde3e247483a response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67542024-12-19T06:06:46.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b0c23c9d-25cc-4d0b-80d2-83db5ef93f1e roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67552024-12-19T06:06:46.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b0c23c9d-25cc-4d0b-80d2-83db5ef93f1e resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67562024-12-19T06:06:46.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = b0c23c9d-25cc-4d0b-80d2-83db5ef93f1e response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67572024-12-19T06:06:47.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d454625c-0467-4e26-bacf-08da983ce40c roles = RoleSet { roles: {} } uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67582024-12-19T06:06:47.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d454625c-0467-4e26-bacf-08da983ce40c resource = Database result = Ok(()) uri = /probes/a9851483-adb5-4271-9f27-41db71133b55
67592024-12-19T06:06:47.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62901 req_id = d454625c-0467-4e26-bacf-08da983ce40c response_code = 200 uri = /probes/a9851483-adb5-4271-9f27-41db71133b55