Max level shown:
12024-11-01T22:30:00.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c931830-ba05-48bc-9b9b-05d820dcf9b7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22024-11-01T22:30:00.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c931830-ba05-48bc-9b9b-05d820dcf9b7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
32024-11-01T22:30:00.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c931830-ba05-48bc-9b9b-05d820dcf9b7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
42024-11-01T22:30:01.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7b837e5c-d93c-459d-a4dc-2120d99d04db roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
52024-11-01T22:30:01.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7b837e5c-d93c-459d-a4dc-2120d99d04db resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
62024-11-01T22:30:01.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7b837e5c-d93c-459d-a4dc-2120d99d04db response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
72024-11-01T22:30:02.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ea9754cc-ac0f-4511-964c-db537079d781 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82024-11-01T22:30:02.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ea9754cc-ac0f-4511-964c-db537079d781 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
92024-11-01T22:30:02.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ea9754cc-ac0f-4511-964c-db537079d781 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
102024-11-01T22:30:03.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bdd1eb89-2965-4852-b3a1-8f167a00a2b1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
112024-11-01T22:30:03.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bdd1eb89-2965-4852-b3a1-8f167a00a2b1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
122024-11-01T22:30:03.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bdd1eb89-2965-4852-b3a1-8f167a00a2b1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
132024-11-01T22:30:04.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c09f35e6-a7cb-409b-a294-4f82c2099e1d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
142024-11-01T22:30:04.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c09f35e6-a7cb-409b-a294-4f82c2099e1d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
152024-11-01T22:30:04.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c09f35e6-a7cb-409b-a294-4f82c2099e1d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
162024-11-01T22:30:05.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1b1370e-c9a2-4b5a-b220-0dd460399472 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
172024-11-01T22:30:05.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1b1370e-c9a2-4b5a-b220-0dd460399472 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
182024-11-01T22:30:05.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1b1370e-c9a2-4b5a-b220-0dd460399472 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
192024-11-01T22:30:06.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0da21b8c-4252-4e92-b0ac-6b56daa3e7f9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
202024-11-01T22:30:06.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0da21b8c-4252-4e92-b0ac-6b56daa3e7f9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
212024-11-01T22:30:06.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0da21b8c-4252-4e92-b0ac-6b56daa3e7f9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
222024-11-01T22:30:07.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d151fd51-8480-42f9-8718-1a522d295b43 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
232024-11-01T22:30:07.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d151fd51-8480-42f9-8718-1a522d295b43 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
242024-11-01T22:30:07.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d151fd51-8480-42f9-8718-1a522d295b43 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
252024-11-01T22:30:08.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
262024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 20.59\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
272024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
282024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
292024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
302024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
312024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
322024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
332024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
342024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
352024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
362024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
372024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
382024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
392024-11-01T22:30:08.436ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
402024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
412024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
422024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
432024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
442024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
452024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.5\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
462024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
472024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
482024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
492024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
502024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
512024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
522024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 19.591\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
532024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
542024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
552024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
562024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
572024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.581\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
582024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
592024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
602024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
612024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
622024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
632024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
642024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
652024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
662024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
672024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
682024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
692024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
702024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
712024-11-01T22:30:08.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
722024-11-01T22:30:08.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
732024-11-01T22:30:08.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
742024-11-01T22:30:08.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 472614153 } })
752024-11-01T22:30:08.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
762024-11-01T22:30:08.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
772024-11-01T22:30:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
782024-11-01T22:30:08.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
792024-11-01T22:30:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
802024-11-01T22:30:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
812024-11-01T22:30:08.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
822024-11-01T22:30:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
832024-11-01T22:30:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
842024-11-01T22:30:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
852024-11-01T22:30:08.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
862024-11-01T22:30:08.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
872024-11-01T22:30:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
882024-11-01T22:30:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
892024-11-01T22:30:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
902024-11-01T22:30:08.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 483193464 } })
912024-11-01T22:30:08.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
922024-11-01T22:30:08.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
932024-11-01T22:30:08.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
942024-11-01T22:30:08.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
952024-11-01T22:30:08.453ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 486259757 } })
962024-11-01T22:30:08.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
972024-11-01T22:30:08.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
982024-11-01T22:30:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
992024-11-01T22:30:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1002024-11-01T22:30:08.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1012024-11-01T22:30:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1022024-11-01T22:30:08.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1032024-11-01T22:30:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1042024-11-01T22:30:08.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1052024-11-01T22:30:08.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1062024-11-01T22:30:08.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1072024-11-01T22:30:08.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1082024-11-01T22:30:08.482ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1092024-11-01T22:30:08.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1102024-11-01T22:30:08.483ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1112024-11-01T22:30:08.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1122024-11-01T22:30:08.483ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1132024-11-01T22:30:08.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1142024-11-01T22:30:08.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.265707ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1152024-11-01T22:30:08.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.056823ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1162024-11-01T22:30:08.485ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1172024-11-01T22:30:08.485ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1182024-11-01T22:30:08.485ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1192024-11-01T22:30:08.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1202024-11-01T22:30:08.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1212024-11-01T22:30:08.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1222024-11-01T22:30:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1232024-11-01T22:30:08.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1242024-11-01T22:30:08.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1252024-11-01T22:30:08.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1262024-11-01T22:30:08.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1272024-11-01T22:30:08.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1282024-11-01T22:30:08.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
1292024-11-01T22:30:08.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1302024-11-01T22:30:08.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1312024-11-01T22:30:08.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
1322024-11-01T22:30:08.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1332024-11-01T22:30:08.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1342024-11-01T22:30:08.496ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.60707ms iteration = 10 status = 0
1352024-11-01T22:30:08.503ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
1362024-11-01T22:30:08.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.426512ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
1372024-11-01T22:30:08.513ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1382024-11-01T22:30:08.513ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.347297ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1392024-11-01T22:30:08.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c5988bdc-3d6b-4636-b5ac-b21ee775f2a1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
1402024-11-01T22:30:08.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c5988bdc-3d6b-4636-b5ac-b21ee775f2a1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
1412024-11-01T22:30:08.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c5988bdc-3d6b-4636-b5ac-b21ee775f2a1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
1422024-11-01T22:30:08.521ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1432024-11-01T22:30:08.521ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1442024-11-01T22:30:08.521ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1452024-11-01T22:30:08.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1462024-11-01T22:30:08.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1472024-11-01T22:30:08.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1482024-11-01T22:30:08.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1492024-11-01T22:30:08.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1502024-11-01T22:30:08.547ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 111.335036ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1512024-11-01T22:30:08.562ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1522024-11-01T22:30:08.562ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1532024-11-01T22:30:08.562ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.934887ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1542024-11-01T22:30:08.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
1552024-11-01T22:30:08.571ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1562024-11-01T22:30:08.571ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c265267-64a8-4774-ab36-33a100d0ec78", "content-length": "26", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
1572024-11-01T22:30:08.571ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1582024-11-01T22:30:08.574ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
1592024-11-01T22:30:08.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1602024-11-01T22:30:08.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1612024-11-01T22:30:08.587ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.012037ms iteration = 13 status = {"physical_disks_added":0}
1622024-11-01T22:30:08.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
1632024-11-01T22:30:08.598ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1642024-11-01T22:30:08.598ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afe15f1f-1d03-4c67-bce2-cc4a6f9daad5", "content-length": "26", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
1652024-11-01T22:30:08.598ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1662024-11-01T22:30:08.600ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1672024-11-01T22:30:08.632ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
1682024-11-01T22:30:08.632ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1692024-11-01T22:30:08.632ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53fa5e67-8a3a-4640-8ee7-06ee950ed07c", "content-length": "26", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
1702024-11-01T22:30:08.632ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1712024-11-01T22:30:08.634ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1722024-11-01T22:30:08.656ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1732024-11-01T22:30:08.656ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1742024-11-01T22:30:08.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca53c3da-eae0-49dd-b196-907b0e690833", "content-length": "372", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
1752024-11-01T22:30:08.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1762024-11-01T22:30:08.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1772024-11-01T22:30:08.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1782024-11-01T22:30:08.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1792024-11-01T22:30:08.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802024-11-01T22:30:08.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1812024-11-01T22:30:08.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1822024-11-01T22:30:08.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1832024-11-01T22:30:08.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-11-01T22:30:08.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1852024-11-01T22:30:08.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1862024-11-01T22:30:08.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1872024-11-01T22:30:08.696ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1882024-11-01T22:30:08.697ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3fbcdc-655a-499f-9ace-9bb512e367ce", "content-length": "1", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
1892024-11-01T22:30:08.698ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1902024-11-01T22:30:08.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1912024-11-01T22:30:08.700ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 264.919652ms iteration = 10 status = null
1922024-11-01T22:30:08.714ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
1932024-11-01T22:30:08.714ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
1942024-11-01T22:30:08.714ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dfa94b73-3be9-4b96-9dc1-884b65c27388", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
1952024-11-01T22:30:08.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1962024-11-01T22:30:08.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1972024-11-01T22:30:08.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1982024-11-01T22:30:08.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1992024-11-01T22:30:08.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2002024-11-01T22:30:08.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2012024-11-01T22:30:08.725ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2022024-11-01T22:30:08.725ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2032024-11-01T22:30:08.725ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "225ee68a-346e-4a0d-b014-7e7042561642", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
2042024-11-01T22:30:08.727ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.542754ms iteration = 11 status = {}
2052024-11-01T22:30:08.783ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2062024-11-01T22:30:08.783ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c353c5e-5e01-47ac-8f80-3e7b014b2351", "content-length": "691", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
2072024-11-01T22:30:08.783ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2082024-11-01T22:30:08.783ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2092024-11-01T22:30:08.783ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2102024-11-01T22:30:08.784ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.862119ms iteration = 10 status = {}
2112024-11-01T22:30:08.792ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 356.455497ms iteration = 10 status = {}
2122024-11-01T22:30:08.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2132024-11-01T22:30:08.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2142024-11-01T22:30:08.855ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
2152024-11-01T22:30:08.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2162024-11-01T22:30:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2172024-11-01T22:30:08.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2182024-11-01T22:30:08.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c3744d0-c99d-4382-aeec-3e66147117c4", "content-length": "134", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
2192024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2202024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
2212024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2222024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2232024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2242024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2252024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2262024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2272024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2282024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2292024-11-01T22:30:08.866ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
2302024-11-01T22:30:08.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2312024-11-01T22:30:08.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2322024-11-01T22:30:08.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2332024-11-01T22:30:08.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0231a8ce-0063-4069-94e6-13f8db1f2b1b", "content-length": "2", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
2342024-11-01T22:30:08.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2352024-11-01T22:30:08.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "14a03dd7-30cd-402f-847a-e14fa69674c0", "content-length": "52", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
2362024-11-01T22:30:08.868ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
2372024-11-01T22:30:08.868ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2382024-11-01T22:30:09.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7fa6f9e2-60ee-40eb-b3ac-90eb27efbe2c", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
2392024-11-01T22:30:09.052ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
2402024-11-01T22:30:09.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2412024-11-01T22:30:09.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b151830-e870-489e-9d74-f3f99db0c8e5", "content-length": "682", "date": "Fri, 01 Nov 2024 22:30:08 GMT"} })
2422024-11-01T22:30:09.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2432024-11-01T22:30:09.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2442024-11-01T22:30:09.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2452024-11-01T22:30:09.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2462024-11-01T22:30:09.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2472024-11-01T22:30:09.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2482024-11-01T22:30:09.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2492024-11-01T22:30:09.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2502024-11-01T22:30:09.073ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 637.008318ms iteration = 10 status = {}
2512024-11-01T22:30:09.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = d40a1761-504c-424c-b580-b361bb122761 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2522024-11-01T22:30:09.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = d40a1761-504c-424c-b580-b361bb122761 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2532024-11-01T22:30:09.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = d40a1761-504c-424c-b580-b361bb122761 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2542024-11-01T22:30:09.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ea8c1c9-1064-4ea9-8525-438dfd00ce6d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2552024-11-01T22:30:09.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ea8c1c9-1064-4ea9-8525-438dfd00ce6d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2562024-11-01T22:30:09.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ea8c1c9-1064-4ea9-8525-438dfd00ce6d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2572024-11-01T22:30:10.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7f22145d-cec9-4dd4-89ea-152cb77df718 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2582024-11-01T22:30:10.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7f22145d-cec9-4dd4-89ea-152cb77df718 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2592024-11-01T22:30:10.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7f22145d-cec9-4dd4-89ea-152cb77df718 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2602024-11-01T22:30:11.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 131012ce-882f-4089-a32f-0af296ad0c4a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2612024-11-01T22:30:11.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 131012ce-882f-4089-a32f-0af296ad0c4a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2622024-11-01T22:30:11.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 131012ce-882f-4089-a32f-0af296ad0c4a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2632024-11-01T22:30:12.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b6e5e7f-4c3c-4a69-b2de-ff6a04c31576 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2642024-11-01T22:30:12.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b6e5e7f-4c3c-4a69-b2de-ff6a04c31576 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2652024-11-01T22:30:12.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b6e5e7f-4c3c-4a69-b2de-ff6a04c31576 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2662024-11-01T22:30:13.190ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1370 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 755a952c-be49-4690-8a15-c531ee6637be response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
2672024-11-01T22:30:13.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b269502-0968-4b36-81e8-1b9c74e7c985 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2682024-11-01T22:30:13.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b269502-0968-4b36-81e8-1b9c74e7c985 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2692024-11-01T22:30:13.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b269502-0968-4b36-81e8-1b9c74e7c985 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2702024-11-01T22:30:14.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4f3ba94f-0fae-4395-a7c4-1fb670b151cd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2712024-11-01T22:30:14.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4f3ba94f-0fae-4395-a7c4-1fb670b151cd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2722024-11-01T22:30:14.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4f3ba94f-0fae-4395-a7c4-1fb670b151cd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2732024-11-01T22:30:15.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cba7300b-8a34-41c6-9dc8-dd2c2b8b5e63 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2742024-11-01T22:30:15.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cba7300b-8a34-41c6-9dc8-dd2c2b8b5e63 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2752024-11-01T22:30:15.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cba7300b-8a34-41c6-9dc8-dd2c2b8b5e63 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2762024-11-01T22:30:16.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 153b3e01-c0bc-4dec-a8ee-cf84b2f7735c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2772024-11-01T22:30:16.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 153b3e01-c0bc-4dec-a8ee-cf84b2f7735c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2782024-11-01T22:30:16.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 153b3e01-c0bc-4dec-a8ee-cf84b2f7735c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2792024-11-01T22:30:17.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 717ce8d4-09b1-4747-b693-a3a54fcb5da1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2802024-11-01T22:30:17.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 717ce8d4-09b1-4747-b693-a3a54fcb5da1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2812024-11-01T22:30:17.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 717ce8d4-09b1-4747-b693-a3a54fcb5da1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
2822024-11-01T22:30:18.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
2832024-11-01T22:30:18.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2842024-11-01T22:30:18.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
2852024-11-01T22:30:18.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2862024-11-01T22:30:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2872024-11-01T22:30:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2882024-11-01T22:30:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892024-11-01T22:30:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2902024-11-01T22:30:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2912024-11-01T22:30:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2922024-11-01T22:30:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2932024-11-01T22:30:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2942024-11-01T22:30:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2952024-11-01T22:30:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2962024-11-01T22:30:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-11-01T22:30:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
2982024-11-01T22:30:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2992024-11-01T22:30:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3002024-11-01T22:30:18.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
3012024-11-01T22:30:18.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.692445ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
3022024-11-01T22:30:18.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.701133ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3032024-11-01T22:30:18.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5900d0ad-d3de-4852-80d4-502a4be5c109 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3042024-11-01T22:30:18.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5900d0ad-d3de-4852-80d4-502a4be5c109 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3052024-11-01T22:30:18.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5900d0ad-d3de-4852-80d4-502a4be5c109 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3062024-11-01T22:30:19.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 06f0e2b1-81c3-4647-a64d-ae060a11a02b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3072024-11-01T22:30:19.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 06f0e2b1-81c3-4647-a64d-ae060a11a02b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3082024-11-01T22:30:19.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 06f0e2b1-81c3-4647-a64d-ae060a11a02b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3092024-11-01T22:30:20.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 43f51927-fa1d-436d-82d3-13b4637975fc roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3102024-11-01T22:30:20.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 43f51927-fa1d-436d-82d3-13b4637975fc resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3112024-11-01T22:30:20.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 43f51927-fa1d-436d-82d3-13b4637975fc response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3122024-11-01T22:30:21.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 54283ed8-cce6-49e8-b40c-d016f6d1113a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3132024-11-01T22:30:21.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 54283ed8-cce6-49e8-b40c-d016f6d1113a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3142024-11-01T22:30:21.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 54283ed8-cce6-49e8-b40c-d016f6d1113a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3152024-11-01T22:30:22.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0ce9a08f-12f0-40fe-8147-612722c87ebb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3162024-11-01T22:30:22.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0ce9a08f-12f0-40fe-8147-612722c87ebb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3172024-11-01T22:30:22.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0ce9a08f-12f0-40fe-8147-612722c87ebb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3182024-11-01T22:30:23.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c148b7fc-28f5-4b0d-944c-9d4821a169a7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3192024-11-01T22:30:23.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c148b7fc-28f5-4b0d-944c-9d4821a169a7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3202024-11-01T22:30:23.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c148b7fc-28f5-4b0d-944c-9d4821a169a7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3212024-11-01T22:30:24.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd2f1d3e-ca9f-4172-8a5e-756ea73f1d06 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3222024-11-01T22:30:24.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd2f1d3e-ca9f-4172-8a5e-756ea73f1d06 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3232024-11-01T22:30:24.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd2f1d3e-ca9f-4172-8a5e-756ea73f1d06 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3242024-11-01T22:30:25.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 800cade2-9065-4769-a8e4-b1181837e649 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3252024-11-01T22:30:25.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 800cade2-9065-4769-a8e4-b1181837e649 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3262024-11-01T22:30:25.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 800cade2-9065-4769-a8e4-b1181837e649 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3272024-11-01T22:30:26.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9476249a-4d61-4000-9eb9-59c0c7f599d7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3282024-11-01T22:30:26.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9476249a-4d61-4000-9eb9-59c0c7f599d7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3292024-11-01T22:30:26.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9476249a-4d61-4000-9eb9-59c0c7f599d7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3302024-11-01T22:30:27.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b24143d-3767-4546-8921-43861e85306a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3312024-11-01T22:30:27.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b24143d-3767-4546-8921-43861e85306a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3322024-11-01T22:30:27.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b24143d-3767-4546-8921-43861e85306a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3332024-11-01T22:30:28.191ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1353 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = a2f59c51-27de-4a5a-9c9f-5ed2a63e0f69 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
3342024-11-01T22:30:28.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
3352024-11-01T22:30:28.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3362024-11-01T22:30:28.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
3372024-11-01T22:30:28.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3382024-11-01T22:30:28.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3392024-11-01T22:30:28.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3402024-11-01T22:30:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3412024-11-01T22:30:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422024-11-01T22:30:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3432024-11-01T22:30:28.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.021121ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3442024-11-01T22:30:28.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3452024-11-01T22:30:28.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3462024-11-01T22:30:28.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3472024-11-01T22:30:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3482024-11-01T22:30:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3492024-11-01T22:30:28.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-11-01T22:30:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
3512024-11-01T22:30:28.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3522024-11-01T22:30:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3532024-11-01T22:30:28.458ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
3542024-11-01T22:30:28.458ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.466511ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
3552024-11-01T22:30:28.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f6591e1f-613a-4f72-bb31-d1b45af6ad43 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3562024-11-01T22:30:28.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f6591e1f-613a-4f72-bb31-d1b45af6ad43 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3572024-11-01T22:30:28.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f6591e1f-613a-4f72-bb31-d1b45af6ad43 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3582024-11-01T22:30:29.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 683bb4a8-d174-4819-a29d-96fd0cbe253c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3592024-11-01T22:30:29.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 683bb4a8-d174-4819-a29d-96fd0cbe253c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3602024-11-01T22:30:29.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 683bb4a8-d174-4819-a29d-96fd0cbe253c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3612024-11-01T22:30:30.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b11746ec-db7a-400e-be68-e381ae38b898 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3622024-11-01T22:30:31.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b11746ec-db7a-400e-be68-e381ae38b898 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3632024-11-01T22:30:31.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b11746ec-db7a-400e-be68-e381ae38b898 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3642024-11-01T22:30:32.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12595fb0-da85-4237-8847-5bcd81e8af8e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3652024-11-01T22:30:32.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12595fb0-da85-4237-8847-5bcd81e8af8e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3662024-11-01T22:30:32.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12595fb0-da85-4237-8847-5bcd81e8af8e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3672024-11-01T22:30:33.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b623a363-d998-4e09-ba24-2b7182cb6bc9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3682024-11-01T22:30:33.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b623a363-d998-4e09-ba24-2b7182cb6bc9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3692024-11-01T22:30:33.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b623a363-d998-4e09-ba24-2b7182cb6bc9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3702024-11-01T22:30:33.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 65ae7f81-18b6-4bbc-9b4d-2689f499976b roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
3712024-11-01T22:30:33.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 65ae7f81-18b6-4bbc-9b4d-2689f499976b resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
3722024-11-01T22:30:33.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 65ae7f81-18b6-4bbc-9b4d-2689f499976b response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
3732024-11-01T22:30:33.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = f869354c-7987-40e1-b173-bc16371b0d5a roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
3742024-11-01T22:30:33.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = f869354c-7987-40e1-b173-bc16371b0d5a resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
3752024-11-01T22:30:33.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = f869354c-7987-40e1-b173-bc16371b0d5a response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
3762024-11-01T22:30:34.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a68de643-c6b0-4431-9b21-9df5db3d516e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3772024-11-01T22:30:34.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a68de643-c6b0-4431-9b21-9df5db3d516e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3782024-11-01T22:30:34.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a68de643-c6b0-4431-9b21-9df5db3d516e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3792024-11-01T22:30:35.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9d1002f8-d6b1-4c06-a9fd-0e009f1132b5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3802024-11-01T22:30:35.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9d1002f8-d6b1-4c06-a9fd-0e009f1132b5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3812024-11-01T22:30:35.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9d1002f8-d6b1-4c06-a9fd-0e009f1132b5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3822024-11-01T22:30:36.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4d133e16-dfd2-4701-8912-cdbe894425c7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3832024-11-01T22:30:36.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4d133e16-dfd2-4701-8912-cdbe894425c7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3842024-11-01T22:30:36.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4d133e16-dfd2-4701-8912-cdbe894425c7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3852024-11-01T22:30:37.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0291e3f1-efbc-4806-baa6-fcf246ddf8e3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3862024-11-01T22:30:37.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0291e3f1-efbc-4806-baa6-fcf246ddf8e3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3872024-11-01T22:30:37.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0291e3f1-efbc-4806-baa6-fcf246ddf8e3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3882024-11-01T22:30:38.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0fc9c432-c150-4dfe-90e6-ccc2b751bb53 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3892024-11-01T22:30:38.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0fc9c432-c150-4dfe-90e6-ccc2b751bb53 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3902024-11-01T22:30:38.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0fc9c432-c150-4dfe-90e6-ccc2b751bb53 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
3912024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
3922024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
3932024-11-01T22:30:38.436ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:20:38.436279306 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3942024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3952024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3962024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
3972024-11-01T22:30:38.436ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
3982024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
3992024-11-01T22:30:38.436ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
4002024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4012024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.36\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
4022024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
4032024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
4042024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4052024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
4062024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
4072024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
4082024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.79\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
4092024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
4102024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
4112024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4122024-11-01T22:30:38.436ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4132024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4142024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
4152024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4162024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
4172024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
4182024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4192024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4202024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
4212024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4222024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4232024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
4242024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
4252024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
4262024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4272024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
4282024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4292024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
4302024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4312024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.59\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
4322024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
4332024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
4342024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.22\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4352024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
4362024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4372024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.71\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4382024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
4392024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
4402024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4412024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4422024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4432024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
4442024-11-01T22:30:38.436ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4452024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4462024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
4472024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
4482024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4492024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4502024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
4512024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
4522024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
4532024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4542024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4552024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4562024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4572024-11-01T22:30:38.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4582024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4592024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4602024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4612024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4622024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4632024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4642024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4652024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4662024-11-01T22:30:38.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 469411159 } })
4672024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4682024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4692024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4702024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4712024-11-01T22:30:38.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 469500060 } })
4722024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4732024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4742024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4752024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4762024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4772024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4782024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4792024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
4802024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.31198ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4812024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
4822024-11-01T22:30:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.30635ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4832024-11-01T22:30:38.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4842024-11-01T22:30:38.439ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:20:38.436279306 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4852024-11-01T22:30:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.379235ms iteration = 6 status = {"expiration":"2024-11-01T22:20:38.436279306Z","pruned":[]}
4862024-11-01T22:30:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.448827ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4872024-11-01T22:30:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4882024-11-01T22:30:38.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4892024-11-01T22:30:38.440ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4902024-11-01T22:30:38.440ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
4912024-11-01T22:30:38.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4922024-11-01T22:30:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4932024-11-01T22:30:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4942024-11-01T22:30:38.441ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
4952024-11-01T22:30:38.441ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
4962024-11-01T22:30:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.557695ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
4972024-11-01T22:30:38.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4982024-11-01T22:30:38.443ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4992024-11-01T22:30:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5002024-11-01T22:30:38.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012024-11-01T22:30:38.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5022024-11-01T22:30:38.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5032024-11-01T22:30:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5042024-11-01T22:30:38.446ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5052024-11-01T22:30:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5062024-11-01T22:30:38.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5072024-11-01T22:30:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5082024-11-01T22:30:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5092024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5102024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5112024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5122024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5132024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5142024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5152024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5162024-11-01T22:30:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5172024-11-01T22:30:38.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5182024-11-01T22:30:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5192024-11-01T22:30:38.449ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.17248ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
5202024-11-01T22:30:38.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212024-11-01T22:30:38.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 482348717 } })
5222024-11-01T22:30:38.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
5232024-11-01T22:30:38.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 482849271 } })
5242024-11-01T22:30:38.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
5252024-11-01T22:30:38.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5262024-11-01T22:30:38.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5272024-11-01T22:30:38.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5282024-11-01T22:30:38.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5292024-11-01T22:30:38.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5302024-11-01T22:30:38.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5312024-11-01T22:30:38.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5322024-11-01T22:30:38.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5332024-11-01T22:30:38.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5342024-11-01T22:30:38.455ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5352024-11-01T22:30:38.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5362024-11-01T22:30:38.456ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5372024-11-01T22:30:38.456ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5382024-11-01T22:30:38.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5392024-11-01T22:30:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5402024-11-01T22:30:38.458ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 489337941 } })
5412024-11-01T22:30:38.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
5422024-11-01T22:30:38.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5432024-11-01T22:30:38.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5442024-11-01T22:30:38.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5452024-11-01T22:30:38.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5462024-11-01T22:30:38.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5472024-11-01T22:30:38.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5482024-11-01T22:30:38.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492024-11-01T22:30:38.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5502024-11-01T22:30:38.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5512024-11-01T22:30:38.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5522024-11-01T22:30:38.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5532024-11-01T22:30:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5542024-11-01T22:30:38.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552024-11-01T22:30:38.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5562024-11-01T22:30:38.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5572024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5582024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5592024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5602024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
5612024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5622024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5632024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5642024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5652024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5662024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5672024-11-01T22:30:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5682024-11-01T22:30:38.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5692024-11-01T22:30:38.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5702024-11-01T22:30:38.474ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5712024-11-01T22:30:38.477ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5722024-11-01T22:30:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5732024-11-01T22:30:38.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5742024-11-01T22:30:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5752024-11-01T22:30:38.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5762024-11-01T22:30:38.479ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5772024-11-01T22:30:38.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5782024-11-01T22:30:38.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5792024-11-01T22:30:38.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5802024-11-01T22:30:38.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5812024-11-01T22:30:38.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5822024-11-01T22:30:38.483ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
5832024-11-01T22:30:38.483ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.673535ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
5842024-11-01T22:30:38.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-11-01T22:30:38.485ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5862024-11-01T22:30:38.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5872024-11-01T22:30:38.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5882024-11-01T22:30:38.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5892024-11-01T22:30:38.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5902024-11-01T22:30:38.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5912024-11-01T22:30:38.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5922024-11-01T22:30:38.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5932024-11-01T22:30:38.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5942024-11-01T22:30:38.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.159241ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5952024-11-01T22:30:38.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5962024-11-01T22:30:38.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5972024-11-01T22:30:38.492ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5982024-11-01T22:30:38.492ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.252067ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5992024-11-01T22:30:38.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6002024-11-01T22:30:38.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6012024-11-01T22:30:38.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022024-11-01T22:30:38.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6032024-11-01T22:30:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6042024-11-01T22:30:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
6052024-11-01T22:30:38.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6062024-11-01T22:30:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6072024-11-01T22:30:38.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6082024-11-01T22:30:38.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092024-11-01T22:30:38.500ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.46626ms iteration = 11 status = 0
6102024-11-01T22:30:38.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6112024-11-01T22:30:38.502ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6122024-11-01T22:30:38.502ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6132024-11-01T22:30:38.502ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.017152ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6142024-11-01T22:30:38.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152024-11-01T22:30:38.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6162024-11-01T22:30:38.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6172024-11-01T22:30:38.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6182024-11-01T22:30:38.504ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6192024-11-01T22:30:38.504ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6202024-11-01T22:30:38.504ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.641434ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6212024-11-01T22:30:38.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6222024-11-01T22:30:38.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6232024-11-01T22:30:38.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6242024-11-01T22:30:38.518ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6252024-11-01T22:30:38.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6262024-11-01T22:30:38.523ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.662016ms iteration = 14 status = {"physical_disks_added":0}
6272024-11-01T22:30:38.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.583377ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6282024-11-01T22:30:38.555ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6292024-11-01T22:30:38.555ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6302024-11-01T22:30:38.555ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6312024-11-01T22:30:38.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6322024-11-01T22:30:38.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6332024-11-01T22:30:38.556ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6342024-11-01T22:30:38.556ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6352024-11-01T22:30:38.556ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6362024-11-01T22:30:38.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6372024-11-01T22:30:38.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6382024-11-01T22:30:38.558ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6392024-11-01T22:30:38.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6402024-11-01T22:30:38.564ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6412024-11-01T22:30:38.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
6422024-11-01T22:30:38.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6432024-11-01T22:30:38.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6442024-11-01T22:30:38.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6452024-11-01T22:30:38.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6462024-11-01T22:30:38.599ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
6472024-11-01T22:30:38.599ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6482024-11-01T22:30:38.599ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0c7b63e-ae3f-48bb-a7af-3ac1683f1e7e", "content-length": "26", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
6492024-11-01T22:30:38.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6502024-11-01T22:30:38.602ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6512024-11-01T22:30:38.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6522024-11-01T22:30:38.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6532024-11-01T22:30:38.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
6542024-11-01T22:30:38.622ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6552024-11-01T22:30:38.623ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f05aaa0b-6a07-4232-8c97-252dd8b8998f", "content-length": "26", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
6562024-11-01T22:30:38.623ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6572024-11-01T22:30:38.623ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
6582024-11-01T22:30:38.623ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6592024-11-01T22:30:38.623ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3f653cc-1e2b-4b2e-b84a-97e15a789a03", "content-length": "26", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
6602024-11-01T22:30:38.623ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6612024-11-01T22:30:38.625ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
6622024-11-01T22:30:38.625ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6632024-11-01T22:30:38.643ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6642024-11-01T22:30:38.643ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 206.72606ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6652024-11-01T22:30:38.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6662024-11-01T22:30:38.721ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "11dff611-2796-47b2-88a0-1a663b5b1b5f", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6672024-11-01T22:30:38.721ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6682024-11-01T22:30:38.723ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ff9bf1b5-b1b9-4fc8-a183-d68ea5cdf3e6", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6692024-11-01T22:30:38.723ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6702024-11-01T22:30:38.725ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6712024-11-01T22:30:38.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 289.180267ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
6722024-11-01T22:30:38.730ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6732024-11-01T22:30:38.730ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6742024-11-01T22:30:38.731ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3c5e971-7e43-4eac-9ccc-8f4d83ec1f4e", "content-length": "372", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
6752024-11-01T22:30:38.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6762024-11-01T22:30:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6772024-11-01T22:30:38.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6782024-11-01T22:30:38.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6792024-11-01T22:30:38.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6802024-11-01T22:30:38.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6812024-11-01T22:30:38.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6822024-11-01T22:30:38.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6832024-11-01T22:30:38.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6842024-11-01T22:30:38.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6852024-11-01T22:30:38.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6862024-11-01T22:30:38.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6872024-11-01T22:30:38.745ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882024-11-01T22:30:38.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6892024-11-01T22:30:38.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6902024-11-01T22:30:38.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6912024-11-01T22:30:38.756ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6922024-11-01T22:30:38.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6932024-11-01T22:30:38.758ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6942024-11-01T22:30:38.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6952024-11-01T22:30:38.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6962024-11-01T22:30:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6972024-11-01T22:30:38.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6982024-11-01T22:30:38.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6992024-11-01T22:30:38.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7002024-11-01T22:30:38.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7012024-11-01T22:30:38.770ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7022024-11-01T22:30:38.770ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "37781688-d6a7-4a27-a2ad-35d5b677f80c", "content-length": "1", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
7032024-11-01T22:30:38.773ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7042024-11-01T22:30:38.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7052024-11-01T22:30:38.776ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7062024-11-01T22:30:38.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7072024-11-01T22:30:38.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-11-01T22:30:38.780ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.891562ms iteration = 11 status = null
7092024-11-01T22:30:38.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7102024-11-01T22:30:38.784ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7112024-11-01T22:30:38.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7122024-11-01T22:30:38.787ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 350.976626ms iteration = 11 status = {}
7132024-11-01T22:30:38.790ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
7142024-11-01T22:30:38.790ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 353.696236ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7152024-11-01T22:30:38.799ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7162024-11-01T22:30:38.800ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7172024-11-01T22:30:38.800ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
7182024-11-01T22:30:38.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7192024-11-01T22:30:38.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7202024-11-01T22:30:38.801ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7212024-11-01T22:30:38.801ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7222024-11-01T22:30:38.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7232024-11-01T22:30:38.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7242024-11-01T22:30:38.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7252024-11-01T22:30:38.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7262024-11-01T22:30:38.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7272024-11-01T22:30:38.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7282024-11-01T22:30:38.812ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
7292024-11-01T22:30:38.812ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7302024-11-01T22:30:38.812ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
7312024-11-01T22:30:38.812ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 375.877094ms iteration = 7 status = {"generation":2}
7322024-11-01T22:30:38.822ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7332024-11-01T22:30:38.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7342024-11-01T22:30:38.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0f8f683e-e4ef-41b8-a844-1badb7a614c0", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
7352024-11-01T22:30:38.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7362024-11-01T22:30:38.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7372024-11-01T22:30:38.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7382024-11-01T22:30:38.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7392024-11-01T22:30:38.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7402024-11-01T22:30:38.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7412024-11-01T22:30:38.833ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7422024-11-01T22:30:38.833ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7432024-11-01T22:30:38.833ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "66cda3f7-e234-479e-a77a-43e1fce9b016", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
7442024-11-01T22:30:38.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-11-01T22:30:38.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462024-11-01T22:30:38.836ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 399.463645ms iteration = 12 status = {}
7472024-11-01T22:30:38.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7482024-11-01T22:30:38.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7492024-11-01T22:30:38.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7502024-11-01T22:30:38.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7512024-11-01T22:30:38.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7522024-11-01T22:30:38.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7532024-11-01T22:30:38.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542024-11-01T22:30:38.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552024-11-01T22:30:38.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7562024-11-01T22:30:38.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7572024-11-01T22:30:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7582024-11-01T22:30:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7592024-11-01T22:30:38.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7602024-11-01T22:30:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7612024-11-01T22:30:38.857ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7622024-11-01T22:30:38.857ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7632024-11-01T22:30:38.857ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
7642024-11-01T22:30:38.857ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 420.892897ms iteration = 7 status = {"generation":1}
7652024-11-01T22:30:38.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-11-01T22:30:38.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-11-01T22:30:38.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7682024-11-01T22:30:38.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7692024-11-01T22:30:38.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702024-11-01T22:30:38.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712024-11-01T22:30:38.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722024-11-01T22:30:38.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-11-01T22:30:38.949ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7742024-11-01T22:30:38.950ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9e13bba-d083-4635-a6b9-b5065274a8b2", "content-length": "691", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
7752024-11-01T22:30:38.950ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7762024-11-01T22:30:38.950ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7772024-11-01T22:30:38.950ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7782024-11-01T22:30:38.951ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 514.81782ms iteration = 11 status = {}
7792024-11-01T22:30:38.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802024-11-01T22:30:38.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812024-11-01T22:30:38.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7822024-11-01T22:30:38.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7832024-11-01T22:30:38.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7842024-11-01T22:30:38.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7852024-11-01T22:30:38.957ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7862024-11-01T22:30:38.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8370e1cd-95e7-49e0-9c38-5a920110c479", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7872024-11-01T22:30:38.958ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7882024-11-01T22:30:38.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892024-11-01T22:30:38.959ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "60090c57-85d8-42f0-bb74-26aad875ae15", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7902024-11-01T22:30:38.959ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7912024-11-01T22:30:38.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7922024-11-01T22:30:38.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7932024-11-01T22:30:38.961ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9b8b98a5-d326-494f-9595-f53608c253b0", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7942024-11-01T22:30:38.961ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7952024-11-01T22:30:38.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7962024-11-01T22:30:38.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972024-11-01T22:30:38.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7982024-11-01T22:30:38.963ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7992024-11-01T22:30:38.963ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 526.983973ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8002024-11-01T22:30:38.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012024-11-01T22:30:38.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8022024-11-01T22:30:38.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8032024-11-01T22:30:38.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8042024-11-01T22:30:38.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8052024-11-01T22:30:38.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8062024-11-01T22:30:38.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8072024-11-01T22:30:38.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8082024-11-01T22:30:38.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8092024-11-01T22:30:38.976ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8102024-11-01T22:30:38.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8112024-11-01T22:30:38.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8122024-11-01T22:30:38.982ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8132024-11-01T22:30:38.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8142024-11-01T22:30:38.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8152024-11-01T22:30:38.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8162024-11-01T22:30:38.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8172024-11-01T22:30:38.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8182024-11-01T22:30:38.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8192024-11-01T22:30:38.988ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8202024-11-01T22:30:38.988ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
8212024-11-01T22:30:38.988ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
8222024-11-01T22:30:39.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8232024-11-01T22:30:39.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8242024-11-01T22:30:39.003ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
8252024-11-01T22:30:39.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8262024-11-01T22:30:39.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8272024-11-01T22:30:39.011ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8282024-11-01T22:30:39.011ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bebf9be-20b0-47b7-af41-8045c6bacc74", "content-length": "134", "date": "Fri, 01 Nov 2024 22:30:39 GMT"} })
8292024-11-01T22:30:39.011ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8302024-11-01T22:30:39.011ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
8312024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8322024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8332024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8342024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8352024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8362024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8372024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8382024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8392024-11-01T22:30:39.012ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
8402024-11-01T22:30:39.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8412024-11-01T22:30:39.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8422024-11-01T22:30:39.015ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8432024-11-01T22:30:39.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fbf6432-6d4d-4f14-8fdb-901bd33b7293", "content-length": "2", "date": "Fri, 01 Nov 2024 22:30:39 GMT"} })
8442024-11-01T22:30:39.015ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8452024-11-01T22:30:39.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b578ffe-2e1d-49bd-9192-e5c6d4363011", "content-length": "52", "date": "Fri, 01 Nov 2024 22:30:39 GMT"} })
8462024-11-01T22:30:39.015ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
8472024-11-01T22:30:39.015ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8482024-11-01T22:30:39.060ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8559b5a7-3301-45c6-8f36-6213ed147b79, time_created: 2024-11-01T22:26:05.243260Z, time_modified: 2024-11-01T22:26:05.243260Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
8492024-11-01T22:30:39.060ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8502024-11-01T22:30:39.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8512024-11-01T22:30:39.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8522024-11-01T22:30:39.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8532024-11-01T22:30:39.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8542024-11-01T22:30:39.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8552024-11-01T22:30:39.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
8562024-11-01T22:30:39.099ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
8572024-11-01T22:30:39.133ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e20ee950-91bf-4446-9886-087dd0783fc8", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
8582024-11-01T22:30:39.133ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
8592024-11-01T22:30:39.133ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8602024-11-01T22:30:39.134ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ebe5dae-583f-475e-ba14-a33d3d82224e", "content-length": "682", "date": "Fri, 01 Nov 2024 22:30:39 GMT"} })
8612024-11-01T22:30:39.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8622024-11-01T22:30:39.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8632024-11-01T22:30:39.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8642024-11-01T22:30:39.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8652024-11-01T22:30:39.140ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "b8742b66-1dca-4f58-9b00-6df82f8892d8", "date": "Fri, 01 Nov 2024 22:30:38 GMT"} })
8662024-11-01T22:30:39.142ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8672024-11-01T22:30:39.142ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 705.995433ms
8682024-11-01T22:30:39.142ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 706.008963ms iteration = 2 status = {}
8692024-11-01T22:30:39.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8702024-11-01T22:30:39.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8712024-11-01T22:30:39.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8722024-11-01T22:30:39.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8732024-11-01T22:30:39.152ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 715.760946ms iteration = 11 status = {}
8742024-11-01T22:30:39.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8f35c895-39e4-4239-b861-f6114cae7234 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8752024-11-01T22:30:39.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8f35c895-39e4-4239-b861-f6114cae7234 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8762024-11-01T22:30:39.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8f35c895-39e4-4239-b861-f6114cae7234 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8772024-11-01T22:30:39.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 1aef0e11-35e3-4e35-9793-6521391ad719 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8782024-11-01T22:30:39.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 1aef0e11-35e3-4e35-9793-6521391ad719 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8792024-11-01T22:30:39.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 1aef0e11-35e3-4e35-9793-6521391ad719 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8802024-11-01T22:30:40.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 66c53c71-3347-44c0-a124-444d5fb58642 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8812024-11-01T22:30:40.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 66c53c71-3347-44c0-a124-444d5fb58642 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8822024-11-01T22:30:40.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 66c53c71-3347-44c0-a124-444d5fb58642 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8832024-11-01T22:30:41.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 845fd59f-9f4e-4957-bec6-c853b8eb05bb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8842024-11-01T22:30:41.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 845fd59f-9f4e-4957-bec6-c853b8eb05bb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8852024-11-01T22:30:41.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 845fd59f-9f4e-4957-bec6-c853b8eb05bb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8862024-11-01T22:30:42.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63317ab8-5b30-410a-9186-527edd993dce roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8872024-11-01T22:30:42.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63317ab8-5b30-410a-9186-527edd993dce resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8882024-11-01T22:30:42.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63317ab8-5b30-410a-9186-527edd993dce response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8892024-11-01T22:30:43.191ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1345 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = cb9246b0-72b0-4857-9d00-8eb94ea599bf response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
8902024-11-01T22:30:43.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9734c5b2-04c1-473e-80c0-d690ede01026 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8912024-11-01T22:30:43.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9734c5b2-04c1-473e-80c0-d690ede01026 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8922024-11-01T22:30:43.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9734c5b2-04c1-473e-80c0-d690ede01026 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8932024-11-01T22:30:44.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dc400129-4204-43cd-b14e-1c6680a9945c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8942024-11-01T22:30:44.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dc400129-4204-43cd-b14e-1c6680a9945c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8952024-11-01T22:30:44.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dc400129-4204-43cd-b14e-1c6680a9945c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8962024-11-01T22:30:45.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dd58959d-8677-4251-91c8-b6bbe2570748 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8972024-11-01T22:30:45.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dd58959d-8677-4251-91c8-b6bbe2570748 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8982024-11-01T22:30:45.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dd58959d-8677-4251-91c8-b6bbe2570748 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
8992024-11-01T22:30:46.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e5148ae9-6d6d-4db0-a717-59e28471fd52 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9002024-11-01T22:30:46.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e5148ae9-6d6d-4db0-a717-59e28471fd52 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9012024-11-01T22:30:46.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e5148ae9-6d6d-4db0-a717-59e28471fd52 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9022024-11-01T22:30:47.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 033fce3f-79c7-4704-ae6e-7c700a382b2a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9032024-11-01T22:30:47.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 033fce3f-79c7-4704-ae6e-7c700a382b2a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9042024-11-01T22:30:47.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 033fce3f-79c7-4704-ae6e-7c700a382b2a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9052024-11-01T22:30:48.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1633da4b-0de0-4b46-be87-c3c9bc259bd3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9062024-11-01T22:30:48.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1633da4b-0de0-4b46-be87-c3c9bc259bd3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9072024-11-01T22:30:48.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1633da4b-0de0-4b46-be87-c3c9bc259bd3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9082024-11-01T22:30:48.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
9092024-11-01T22:30:48.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
9102024-11-01T22:30:48.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9112024-11-01T22:30:48.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9122024-11-01T22:30:48.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9132024-11-01T22:30:48.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9142024-11-01T22:30:48.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9152024-11-01T22:30:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9162024-11-01T22:30:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9172024-11-01T22:30:48.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.290953ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9182024-11-01T22:30:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9192024-11-01T22:30:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9202024-11-01T22:30:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9212024-11-01T22:30:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9222024-11-01T22:30:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9232024-11-01T22:30:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9242024-11-01T22:30:48.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
9252024-11-01T22:30:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9262024-11-01T22:30:48.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9272024-11-01T22:30:48.455ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
9282024-11-01T22:30:48.455ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.235026ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
9292024-11-01T22:30:48.483ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40435
9302024-11-01T22:30:48.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40435 req_id = e1350757-e8d0-4d14-a366-bb64ef08373b roles = RoleSet { roles: {} } uri = /metrics/producers
9312024-11-01T22:30:48.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40435 req_id = e1350757-e8d0-4d14-a366-bb64ef08373b resource = Database result = Ok(()) uri = /metrics/producers
9322024-11-01T22:30:48.519ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = eb6325c7-d1c1-4d78-89ec-4210cb4d49a2
9332024-11-01T22:30:48.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36285 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40435 req_id = e1350757-e8d0-4d14-a366-bb64ef08373b response_code = 201 uri = /metrics/producers
9342024-11-01T22:30:49.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd59b757-497a-426b-8825-dadb41193764 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9352024-11-01T22:30:49.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd59b757-497a-426b-8825-dadb41193764 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9362024-11-01T22:30:49.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd59b757-497a-426b-8825-dadb41193764 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9372024-11-01T22:30:50.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f77c9db-40f3-4ade-9042-02298b0b3cb0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9382024-11-01T22:30:50.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f77c9db-40f3-4ade-9042-02298b0b3cb0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9392024-11-01T22:30:50.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f77c9db-40f3-4ade-9042-02298b0b3cb0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9402024-11-01T22:30:50.539ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40949
9412024-11-01T22:30:50.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40949 req_id = fb6859f8-7878-4c07-a6e2-c43e1900fbbb roles = RoleSet { roles: {} } uri = /metrics/producers
9422024-11-01T22:30:50.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40949 req_id = fb6859f8-7878-4c07-a6e2-c43e1900fbbb resource = Database result = Ok(()) uri = /metrics/producers
9432024-11-01T22:30:50.580ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 0c64e418-1894-441d-86b0-7394a1124e4a
9442024-11-01T22:30:50.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40771 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40949 req_id = fb6859f8-7878-4c07-a6e2-c43e1900fbbb response_code = 201 uri = /metrics/producers
9452024-11-01T22:30:51.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 450624a9-2212-44c7-9578-f53f15f9eaea roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9462024-11-01T22:30:51.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 450624a9-2212-44c7-9578-f53f15f9eaea resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9472024-11-01T22:30:51.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 450624a9-2212-44c7-9578-f53f15f9eaea response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9482024-11-01T22:30:52.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d153e7d-ac49-4ac5-96b5-474c1f910dc2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9492024-11-01T22:30:52.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d153e7d-ac49-4ac5-96b5-474c1f910dc2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9502024-11-01T22:30:52.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d153e7d-ac49-4ac5-96b5-474c1f910dc2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9512024-11-01T22:30:53.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 359610a0-8002-4ce8-bb68-5ca4494d9f1b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9522024-11-01T22:30:53.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 359610a0-8002-4ce8-bb68-5ca4494d9f1b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9532024-11-01T22:30:53.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 359610a0-8002-4ce8-bb68-5ca4494d9f1b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9542024-11-01T22:30:54.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 361fdc6c-827f-4b1d-9478-6bcb565c37c8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9552024-11-01T22:30:54.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 361fdc6c-827f-4b1d-9478-6bcb565c37c8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9562024-11-01T22:30:54.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 361fdc6c-827f-4b1d-9478-6bcb565c37c8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9572024-11-01T22:30:55.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bc71262-7b1a-4d71-9e66-09d2be8afe66 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9582024-11-01T22:30:55.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bc71262-7b1a-4d71-9e66-09d2be8afe66 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9592024-11-01T22:30:55.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bc71262-7b1a-4d71-9e66-09d2be8afe66 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9602024-11-01T22:30:56.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9125f19e-2d5d-4328-b3f4-5dd1cf7d0798 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9612024-11-01T22:30:56.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9125f19e-2d5d-4328-b3f4-5dd1cf7d0798 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9622024-11-01T22:30:56.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9125f19e-2d5d-4328-b3f4-5dd1cf7d0798 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9632024-11-01T22:30:57.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ba9d664-19cd-4aa6-a77b-a9d6ab607975 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9642024-11-01T22:30:57.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ba9d664-19cd-4aa6-a77b-a9d6ab607975 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9652024-11-01T22:30:57.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ba9d664-19cd-4aa6-a77b-a9d6ab607975 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9662024-11-01T22:30:58.192ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = ddc7d7e4-efb2-475e-b372-e483b00f92f6 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
9672024-11-01T22:30:58.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
9682024-11-01T22:30:58.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
9692024-11-01T22:30:58.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9702024-11-01T22:30:58.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9712024-11-01T22:30:58.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9722024-11-01T22:30:58.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9732024-11-01T22:30:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9742024-11-01T22:30:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9752024-11-01T22:30:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9762024-11-01T22:30:58.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.649588ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9772024-11-01T22:30:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9782024-11-01T22:30:58.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9792024-11-01T22:30:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9802024-11-01T22:30:58.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9812024-11-01T22:30:58.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9822024-11-01T22:30:58.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9832024-11-01T22:30:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
9842024-11-01T22:30:58.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9852024-11-01T22:30:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9862024-11-01T22:30:58.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
9872024-11-01T22:30:58.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.529666ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
9882024-11-01T22:30:58.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 417f9036-ba4a-422c-a6f6-d113d1672c9c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9892024-11-01T22:30:58.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 417f9036-ba4a-422c-a6f6-d113d1672c9c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9902024-11-01T22:30:58.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 417f9036-ba4a-422c-a6f6-d113d1672c9c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9912024-11-01T22:30:59.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e10a969a-b523-4aa4-804c-5498dbd48979 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9922024-11-01T22:30:59.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e10a969a-b523-4aa4-804c-5498dbd48979 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9932024-11-01T22:30:59.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e10a969a-b523-4aa4-804c-5498dbd48979 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9942024-11-01T22:31:00.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12f78acc-0790-49dc-ab1a-d75aa2da7600 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9952024-11-01T22:31:00.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12f78acc-0790-49dc-ab1a-d75aa2da7600 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9962024-11-01T22:31:00.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12f78acc-0790-49dc-ab1a-d75aa2da7600 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9972024-11-01T22:31:01.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5edf90cc-6f38-44be-9945-4ba7b791ddaf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9982024-11-01T22:31:01.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5edf90cc-6f38-44be-9945-4ba7b791ddaf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
9992024-11-01T22:31:01.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5edf90cc-6f38-44be-9945-4ba7b791ddaf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10002024-11-01T22:31:02.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f27c131f-407e-435f-8b70-297ebc13f532 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10012024-11-01T22:31:02.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f27c131f-407e-435f-8b70-297ebc13f532 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10022024-11-01T22:31:02.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f27c131f-407e-435f-8b70-297ebc13f532 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10032024-11-01T22:31:03.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = d3dbf4b5-31e7-4e06-9706-141beffd53e4 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
10042024-11-01T22:31:03.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = d3dbf4b5-31e7-4e06-9706-141beffd53e4 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
10052024-11-01T22:31:03.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = d3dbf4b5-31e7-4e06-9706-141beffd53e4 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
10062024-11-01T22:31:03.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 2c3f1bd8-b4fa-4a7f-8905-fd4b1df3770b roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
10072024-11-01T22:31:03.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 2c3f1bd8-b4fa-4a7f-8905-fd4b1df3770b resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
10082024-11-01T22:31:03.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 2c3f1bd8-b4fa-4a7f-8905-fd4b1df3770b response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
10092024-11-01T22:31:03.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c7b72d8e-406b-4d4f-a83c-0b789f9aed9d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10102024-11-01T22:31:03.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c7b72d8e-406b-4d4f-a83c-0b789f9aed9d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10112024-11-01T22:31:03.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c7b72d8e-406b-4d4f-a83c-0b789f9aed9d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10122024-11-01T22:31:04.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 13abb7f4-eaf5-41b2-ba58-8d11d068ea86 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10132024-11-01T22:31:04.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 13abb7f4-eaf5-41b2-ba58-8d11d068ea86 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10142024-11-01T22:31:04.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 13abb7f4-eaf5-41b2-ba58-8d11d068ea86 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10152024-11-01T22:31:05.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3274f721-3404-43d7-9d5e-45d45ae7137b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10162024-11-01T22:31:05.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3274f721-3404-43d7-9d5e-45d45ae7137b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10172024-11-01T22:31:05.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3274f721-3404-43d7-9d5e-45d45ae7137b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10182024-11-01T22:31:06.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6e5f0e1-3848-4bbb-b42e-467f6d1eb9ed roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10192024-11-01T22:31:06.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6e5f0e1-3848-4bbb-b42e-467f6d1eb9ed resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10202024-11-01T22:31:06.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6e5f0e1-3848-4bbb-b42e-467f6d1eb9ed response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10212024-11-01T22:31:07.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d3cc66cd-22ca-4478-92d6-50a3dc6da5b4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10222024-11-01T22:31:07.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d3cc66cd-22ca-4478-92d6-50a3dc6da5b4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10232024-11-01T22:31:07.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d3cc66cd-22ca-4478-92d6-50a3dc6da5b4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
10242024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
10252024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10262024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
10272024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
10282024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10292024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
10302024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10312024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10322024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
10332024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10342024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10352024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
10362024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
10372024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10382024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
10392024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
10402024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.23\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
10412024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
10422024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
10432024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10442024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10452024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
10462024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10472024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10482024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
10492024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
10502024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.14\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
10512024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
10522024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
10532024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10542024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.23\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10552024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.4\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10562024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
10572024-11-01T22:31:08.436ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10582024-11-01T22:31:08.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10592024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10602024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10612024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10622024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10632024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10642024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10652024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10662024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10672024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10682024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10692024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10702024-11-01T22:31:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10712024-11-01T22:31:08.439ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 471495235 } })
10722024-11-01T22:31:08.439ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.266545ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10732024-11-01T22:31:08.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
10742024-11-01T22:31:08.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10752024-11-01T22:31:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10762024-11-01T22:31:08.440ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10772024-11-01T22:31:08.440ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10782024-11-01T22:31:08.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10792024-11-01T22:31:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10802024-11-01T22:31:08.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10812024-11-01T22:31:08.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822024-11-01T22:31:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10832024-11-01T22:31:08.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10842024-11-01T22:31:08.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-11-01T22:31:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10862024-11-01T22:31:08.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10872024-11-01T22:31:08.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10882024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10892024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10902024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10912024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10922024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10932024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10942024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10952024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10962024-11-01T22:31:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10972024-11-01T22:31:08.446ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 478450168 } })
10982024-11-01T22:31:08.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
10992024-11-01T22:31:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11002024-11-01T22:31:08.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11012024-11-01T22:31:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11022024-11-01T22:31:08.448ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11032024-11-01T22:31:08.448ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11042024-11-01T22:31:08.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11052024-11-01T22:31:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11062024-11-01T22:31:08.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 480702695 } })
11072024-11-01T22:31:08.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
11082024-11-01T22:31:08.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11092024-11-01T22:31:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11102024-11-01T22:31:08.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11112024-11-01T22:31:08.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11122024-11-01T22:31:08.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11132024-11-01T22:31:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11142024-11-01T22:31:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11152024-11-01T22:31:08.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11162024-11-01T22:31:08.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11172024-11-01T22:31:08.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11182024-11-01T22:31:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11192024-11-01T22:31:08.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-11-01T22:31:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
11212024-11-01T22:31:08.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11222024-11-01T22:31:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11232024-11-01T22:31:08.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11242024-11-01T22:31:08.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11252024-11-01T22:31:08.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11262024-11-01T22:31:08.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
11272024-11-01T22:31:08.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.941089ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
11282024-11-01T22:31:08.469ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292024-11-01T22:31:08.470ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11302024-11-01T22:31:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11312024-11-01T22:31:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11322024-11-01T22:31:08.471ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11332024-11-01T22:31:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11342024-11-01T22:31:08.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11352024-11-01T22:31:08.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11362024-11-01T22:31:08.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 35.986423ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11372024-11-01T22:31:08.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.460757ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11382024-11-01T22:31:08.479ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11392024-11-01T22:31:08.479ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11402024-11-01T22:31:08.479ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 42.889125ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11412024-11-01T22:31:08.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11422024-11-01T22:31:08.520ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11432024-11-01T22:31:08.521ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "975b745a-6c1f-4356-a872-7db4d2bed752", "content-length": "26", "date": "Fri, 01 Nov 2024 22:31:07 GMT"} })
11442024-11-01T22:31:08.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11452024-11-01T22:31:08.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11462024-11-01T22:31:08.556ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11472024-11-01T22:31:08.556ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11482024-11-01T22:31:08.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11492024-11-01T22:31:08.556ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7c36f17-e9c7-4269-8462-6d027db78888", "content-length": "26", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
11502024-11-01T22:31:08.556ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11512024-11-01T22:31:08.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11522024-11-01T22:31:08.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11532024-11-01T22:31:08.564ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.879092ms iteration = 15 status = {"physical_disks_added":0}
11542024-11-01T22:31:08.638ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
11552024-11-01T22:31:08.638ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11562024-11-01T22:31:08.638ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40591678-394a-4878-96d3-959a28c87a18", "content-length": "26", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
11572024-11-01T22:31:08.638ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11582024-11-01T22:31:08.639ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 203.095423ms iteration = 12 status = {}
11592024-11-01T22:31:08.639ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
11602024-11-01T22:31:08.656ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11612024-11-01T22:31:08.656ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11622024-11-01T22:31:08.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c48212c-fcd5-4a78-889f-96ae786e04f0", "content-length": "372", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
11632024-11-01T22:31:08.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11642024-11-01T22:31:08.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11652024-11-01T22:31:08.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11662024-11-01T22:31:08.659ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11672024-11-01T22:31:08.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11682024-11-01T22:31:08.659ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a78c5e96-3b50-4e48-a1c0-c47584933298", "content-length": "1", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
11692024-11-01T22:31:08.662ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11702024-11-01T22:31:08.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11712024-11-01T22:31:08.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722024-11-01T22:31:08.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
11732024-11-01T22:31:08.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11742024-11-01T22:31:08.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11752024-11-01T22:31:08.667ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.083046ms iteration = 12 status = null
11762024-11-01T22:31:08.667ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 231.200906ms iteration = 12 status = 0
11772024-11-01T22:31:08.707ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11782024-11-01T22:31:08.707ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 270.400705ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11792024-11-01T22:31:08.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11802024-11-01T22:31:08.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11812024-11-01T22:31:08.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11822024-11-01T22:31:08.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11832024-11-01T22:31:08.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11842024-11-01T22:31:08.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11852024-11-01T22:31:08.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11862024-11-01T22:31:08.718ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11872024-11-01T22:31:08.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11882024-11-01T22:31:08.718ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bba30ea8-0b37-47a2-a192-e1ce50368a0a", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
11892024-11-01T22:31:08.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11902024-11-01T22:31:08.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11912024-11-01T22:31:08.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11922024-11-01T22:31:08.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11932024-11-01T22:31:08.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11942024-11-01T22:31:08.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11952024-11-01T22:31:08.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11962024-11-01T22:31:08.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11972024-11-01T22:31:08.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11982024-11-01T22:31:08.727ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11992024-11-01T22:31:08.727ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12002024-11-01T22:31:08.728ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "958436c4-e750-4378-8027-2363e9759b00", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
12012024-11-01T22:31:08.729ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.086956ms iteration = 13 status = {}
12022024-11-01T22:31:08.782ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12032024-11-01T22:31:08.782ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c97691cd-0356-4699-ac1a-d9739d809eeb", "content-length": "691", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
12042024-11-01T22:31:08.782ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12052024-11-01T22:31:08.782ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12062024-11-01T22:31:08.782ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12072024-11-01T22:31:08.783ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.143507ms iteration = 12 status = {}
12082024-11-01T22:31:08.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12092024-11-01T22:31:08.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12102024-11-01T22:31:08.795ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
12112024-11-01T22:31:08.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12122024-11-01T22:31:08.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12132024-11-01T22:31:08.806ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12142024-11-01T22:31:08.807ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e13f5bf-d1c4-457e-8265-dfbf73423443", "content-length": "134", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
12152024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12162024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
12172024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12182024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12192024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12202024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12212024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12222024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12232024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12242024-11-01T22:31:08.807ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12252024-11-01T22:31:08.808ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
12262024-11-01T22:31:08.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12272024-11-01T22:31:08.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12282024-11-01T22:31:08.810ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12292024-11-01T22:31:08.810ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "82be36c1-cccd-4fde-8285-cfc373b0c161", "content-length": "2", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
12302024-11-01T22:31:08.810ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12312024-11-01T22:31:08.810ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "85fb9067-ea17-43e5-a262-e7042fcab256", "content-length": "52", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
12322024-11-01T22:31:08.810ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
12332024-11-01T22:31:08.810ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12342024-11-01T22:31:08.918ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bba6bed1-42a3-4abd-810e-7e11c54c3133", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
12352024-11-01T22:31:08.918ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
12362024-11-01T22:31:08.918ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12372024-11-01T22:31:08.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f8b84220-3173-4595-8276-f578062c9cc2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12382024-11-01T22:31:08.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f8b84220-3173-4595-8276-f578062c9cc2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12392024-11-01T22:31:08.918ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "74d5913a-cf9b-4585-ba20-6e6220297862", "content-length": "682", "date": "Fri, 01 Nov 2024 22:31:08 GMT"} })
12402024-11-01T22:31:08.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12412024-11-01T22:31:08.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12422024-11-01T22:31:08.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f8b84220-3173-4595-8276-f578062c9cc2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12432024-11-01T22:31:08.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12442024-11-01T22:31:08.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12452024-11-01T22:31:08.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12462024-11-01T22:31:08.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12472024-11-01T22:31:08.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12482024-11-01T22:31:08.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12492024-11-01T22:31:08.936ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.083569ms iteration = 12 status = {}
12502024-11-01T22:31:09.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 99b1c3ec-00f3-460b-8478-5b5960dbee32 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12512024-11-01T22:31:09.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 99b1c3ec-00f3-460b-8478-5b5960dbee32 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12522024-11-01T22:31:09.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 99b1c3ec-00f3-460b-8478-5b5960dbee32 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12532024-11-01T22:31:09.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8a6219a7-d3a6-43f4-bea1-48d9d0fa725c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12542024-11-01T22:31:09.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8a6219a7-d3a6-43f4-bea1-48d9d0fa725c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12552024-11-01T22:31:09.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8a6219a7-d3a6-43f4-bea1-48d9d0fa725c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12562024-11-01T22:31:10.612ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
12572024-11-01T22:31:10.612ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
12582024-11-01T22:31:10.641ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
12592024-11-01T22:31:10.642ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:42666
12602024-11-01T22:31:10.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42666 req_id = 3f422251-2e6d-44bf-9778-d510b0f4fe63 roles = RoleSet { roles: {} } uri = /metrics/producers
12612024-11-01T22:31:10.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42666 req_id = 3f422251-2e6d-44bf-9778-d510b0f4fe63 resource = Database result = Ok(()) uri = /metrics/producers
12622024-11-01T22:31:10.686ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
12632024-11-01T22:31:10.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43872 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42666 req_id = 3f422251-2e6d-44bf-9778-d510b0f4fe63 response_code = 201 uri = /metrics/producers
12642024-11-01T22:31:10.686ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3f422251-2e6d-44bf-9778-d510b0f4fe63", "content-length": "41", "date": "Fri, 01 Nov 2024 22:31:10 GMT"} })
12652024-11-01T22:31:10.687ZDEBGnexus (producer-registration-task): registered with nexus successfully
12662024-11-01T22:31:10.687ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
12672024-11-01T22:31:10.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 103fbbeb-603b-4860-a520-83bd15a1cd1a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12682024-11-01T22:31:10.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 103fbbeb-603b-4860-a520-83bd15a1cd1a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12692024-11-01T22:31:10.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 103fbbeb-603b-4860-a520-83bd15a1cd1a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12702024-11-01T22:31:10.995ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63140
12712024-11-01T22:31:10.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63140 req_id = 79f8184a-e351-4b83-a751-138a96375aac roles = RoleSet { roles: {} } uri = /metrics/producers
12722024-11-01T22:31:10.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63140 req_id = 79f8184a-e351-4b83-a751-138a96375aac resource = Database result = Ok(()) uri = /metrics/producers
12732024-11-01T22:31:11.036ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = f3786bce-13d3-45c6-95c4-d92d9e1f531e
12742024-11-01T22:31:11.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41043 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63140 req_id = 79f8184a-e351-4b83-a751-138a96375aac response_code = 201 uri = /metrics/producers
12752024-11-01T22:31:11.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7e9c1405-4474-44f6-986c-8183e9ba3d0a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12762024-11-01T22:31:11.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7e9c1405-4474-44f6-986c-8183e9ba3d0a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12772024-11-01T22:31:11.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7e9c1405-4474-44f6-986c-8183e9ba3d0a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12782024-11-01T22:31:12.585ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:65253
12792024-11-01T22:31:12.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65253 req_id = 79461cca-5984-4c1b-89cb-090aef4160c0 roles = RoleSet { roles: {} } uri = /metrics/producers
12802024-11-01T22:31:12.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65253 req_id = 79461cca-5984-4c1b-89cb-090aef4160c0 resource = Database result = Ok(()) uri = /metrics/producers
12812024-11-01T22:31:12.619ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 6a9b750b-1518-4ee5-bf47-863dffe85843
12822024-11-01T22:31:12.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34245 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65253 req_id = 79461cca-5984-4c1b-89cb-090aef4160c0 response_code = 201 uri = /metrics/producers
12832024-11-01T22:31:13.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e913679-8f76-4dea-a533-08807e576cd4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12842024-11-01T22:31:13.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e913679-8f76-4dea-a533-08807e576cd4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12852024-11-01T22:31:13.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e913679-8f76-4dea-a533-08807e576cd4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12862024-11-01T22:31:13.192ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1329 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 41751fa7-ad40-4753-8fac-14d4acfc8b71 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
12872024-11-01T22:31:14.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 84b09383-663f-4c3f-a4cd-59489bccea65 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12882024-11-01T22:31:14.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 84b09383-663f-4c3f-a4cd-59489bccea65 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12892024-11-01T22:31:14.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 84b09383-663f-4c3f-a4cd-59489bccea65 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12902024-11-01T22:31:15.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8742a6ee-2c51-4edb-824f-79042025df3f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12912024-11-01T22:31:15.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8742a6ee-2c51-4edb-824f-79042025df3f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12922024-11-01T22:31:15.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8742a6ee-2c51-4edb-824f-79042025df3f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12932024-11-01T22:31:15.500ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45067
12942024-11-01T22:31:15.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45067 req_id = 93309bae-2f28-4c12-a81d-d3f9adf34f16 roles = RoleSet { roles: {} } uri = /metrics/producers
12952024-11-01T22:31:15.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45067 req_id = 93309bae-2f28-4c12-a81d-d3f9adf34f16 resource = Database result = Ok(()) uri = /metrics/producers
12962024-11-01T22:31:15.535ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 66c10e19-a80d-4554-a39b-bc1969f7015e
12972024-11-01T22:31:15.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35502 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45067 req_id = 93309bae-2f28-4c12-a81d-d3f9adf34f16 response_code = 201 uri = /metrics/producers
12982024-11-01T22:31:16.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aec164ed-405a-4870-addf-161413bf36ca roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
12992024-11-01T22:31:16.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aec164ed-405a-4870-addf-161413bf36ca resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13002024-11-01T22:31:16.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aec164ed-405a-4870-addf-161413bf36ca response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13012024-11-01T22:31:17.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce265167-c6c2-4fba-b3ee-60002931c2a3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13022024-11-01T22:31:17.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce265167-c6c2-4fba-b3ee-60002931c2a3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13032024-11-01T22:31:17.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce265167-c6c2-4fba-b3ee-60002931c2a3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13042024-11-01T22:31:18.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9c04c4b4-cb7f-4baf-b5de-0d90ea10496f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13052024-11-01T22:31:18.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9c04c4b4-cb7f-4baf-b5de-0d90ea10496f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13062024-11-01T22:31:18.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9c04c4b4-cb7f-4baf-b5de-0d90ea10496f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13072024-11-01T22:31:18.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 65201343-1130-4ee4-b1e8-f775d54d303d roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
13082024-11-01T22:31:18.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 65201343-1130-4ee4-b1e8-f775d54d303d resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
13092024-11-01T22:31:18.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 65201343-1130-4ee4-b1e8-f775d54d303d response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
13102024-11-01T22:31:18.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 33c95c05-629d-4e7b-993f-5f4a03d6720d roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
13112024-11-01T22:31:18.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 33c95c05-629d-4e7b-993f-5f4a03d6720d resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
13122024-11-01T22:31:18.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 33c95c05-629d-4e7b-993f-5f4a03d6720d response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
13132024-11-01T22:31:18.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
13142024-11-01T22:31:18.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13152024-11-01T22:31:18.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
13162024-11-01T22:31:18.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13172024-11-01T22:31:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13182024-11-01T22:31:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13192024-11-01T22:31:18.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13202024-11-01T22:31:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13212024-11-01T22:31:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13222024-11-01T22:31:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13232024-11-01T22:31:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13242024-11-01T22:31:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13252024-11-01T22:31:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13262024-11-01T22:31:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
13272024-11-01T22:31:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13282024-11-01T22:31:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13292024-11-01T22:31:18.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
13302024-11-01T22:31:18.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.276544ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
13312024-11-01T22:31:18.465ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13322024-11-01T22:31:18.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13332024-11-01T22:31:18.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.453516ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13342024-11-01T22:31:19.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53da0009-fd38-4f54-a5c5-96985eb62b0a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13352024-11-01T22:31:19.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53da0009-fd38-4f54-a5c5-96985eb62b0a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13362024-11-01T22:31:19.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53da0009-fd38-4f54-a5c5-96985eb62b0a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13372024-11-01T22:31:19.750ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58455
13382024-11-01T22:31:19.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58455 req_id = 4b17357c-dead-4ff4-91e6-8aea4b845fac roles = RoleSet { roles: {} } uri = /metrics/producers
13392024-11-01T22:31:19.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58455 req_id = 4b17357c-dead-4ff4-91e6-8aea4b845fac resource = Database result = Ok(()) uri = /metrics/producers
13402024-11-01T22:31:19.787ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
13412024-11-01T22:31:19.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37009 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58455 req_id = 4b17357c-dead-4ff4-91e6-8aea4b845fac response_code = 201 uri = /metrics/producers
13422024-11-01T22:31:20.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26c4e2e5-a3f9-49f0-b3ed-81126828d5e5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13432024-11-01T22:31:20.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26c4e2e5-a3f9-49f0-b3ed-81126828d5e5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13442024-11-01T22:31:20.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26c4e2e5-a3f9-49f0-b3ed-81126828d5e5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13452024-11-01T22:31:21.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f554f9-1615-4d56-a79d-bcc76bb509d7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13462024-11-01T22:31:21.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f554f9-1615-4d56-a79d-bcc76bb509d7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13472024-11-01T22:31:21.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f554f9-1615-4d56-a79d-bcc76bb509d7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13482024-11-01T22:31:22.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9d2b3e8f-2509-4327-a85d-80fecadb0662 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13492024-11-01T22:31:22.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9d2b3e8f-2509-4327-a85d-80fecadb0662 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13502024-11-01T22:31:22.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9d2b3e8f-2509-4327-a85d-80fecadb0662 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13512024-11-01T22:31:23.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 33c7b82a-8fa7-4495-a44e-39e819238a58 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13522024-11-01T22:31:23.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 33c7b82a-8fa7-4495-a44e-39e819238a58 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13532024-11-01T22:31:23.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 33c7b82a-8fa7-4495-a44e-39e819238a58 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13542024-11-01T22:31:24.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b787a65f-b069-4588-a771-843cb07eafee roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13552024-11-01T22:31:24.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b787a65f-b069-4588-a771-843cb07eafee resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13562024-11-01T22:31:24.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b787a65f-b069-4588-a771-843cb07eafee response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13572024-11-01T22:31:25.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 66d8adab-02ed-42e0-b797-77e9f3b2ec4b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13582024-11-01T22:31:25.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 66d8adab-02ed-42e0-b797-77e9f3b2ec4b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13592024-11-01T22:31:25.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 66d8adab-02ed-42e0-b797-77e9f3b2ec4b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13602024-11-01T22:31:26.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7625cc7a-4f44-48c5-b6b2-9e5a5d0059b1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13612024-11-01T22:31:26.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7625cc7a-4f44-48c5-b6b2-9e5a5d0059b1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13622024-11-01T22:31:26.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7625cc7a-4f44-48c5-b6b2-9e5a5d0059b1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13632024-11-01T22:31:27.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2e4e16df-4073-4312-b2ea-1e50dbb2c2e3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13642024-11-01T22:31:27.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2e4e16df-4073-4312-b2ea-1e50dbb2c2e3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13652024-11-01T22:31:27.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2e4e16df-4073-4312-b2ea-1e50dbb2c2e3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13662024-11-01T22:31:28.192ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 31320fe3-8f4d-4ee7-a99c-3eda8fc61ec5 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
13672024-11-01T22:31:28.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0e00a199-d7ff-4a46-820c-6b3447385542 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13682024-11-01T22:31:28.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0e00a199-d7ff-4a46-820c-6b3447385542 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13692024-11-01T22:31:28.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0e00a199-d7ff-4a46-820c-6b3447385542 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13702024-11-01T22:31:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
13712024-11-01T22:31:28.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
13722024-11-01T22:31:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13732024-11-01T22:31:28.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13742024-11-01T22:31:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13752024-11-01T22:31:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13762024-11-01T22:31:28.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13772024-11-01T22:31:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13782024-11-01T22:31:28.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13792024-11-01T22:31:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13802024-11-01T22:31:28.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13812024-11-01T22:31:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13822024-11-01T22:31:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13832024-11-01T22:31:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
13842024-11-01T22:31:28.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13852024-11-01T22:31:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13862024-11-01T22:31:28.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
13872024-11-01T22:31:28.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.513631ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
13882024-11-01T22:31:28.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13892024-11-01T22:31:28.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13902024-11-01T22:31:28.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.090732ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13912024-11-01T22:31:29.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0984fddb-7980-4641-9bc5-7ee34b278666 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13922024-11-01T22:31:29.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0984fddb-7980-4641-9bc5-7ee34b278666 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13932024-11-01T22:31:29.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0984fddb-7980-4641-9bc5-7ee34b278666 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13942024-11-01T22:31:30.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bd33a4c7-3129-4b37-8800-c364e663b3a0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13952024-11-01T22:31:30.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bd33a4c7-3129-4b37-8800-c364e663b3a0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13962024-11-01T22:31:30.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bd33a4c7-3129-4b37-8800-c364e663b3a0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13972024-11-01T22:31:31.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 418e2f62-0f19-44bc-985d-c8b50d48319b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13982024-11-01T22:31:31.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 418e2f62-0f19-44bc-985d-c8b50d48319b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
13992024-11-01T22:31:31.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 418e2f62-0f19-44bc-985d-c8b50d48319b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14002024-11-01T22:31:32.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d11faa82-b307-459d-8f85-3780d848134d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14012024-11-01T22:31:32.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d11faa82-b307-459d-8f85-3780d848134d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14022024-11-01T22:31:32.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d11faa82-b307-459d-8f85-3780d848134d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14032024-11-01T22:31:33.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b0f4fcb5-8a67-4592-8512-8f63d4e5f8ce roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14042024-11-01T22:31:33.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b0f4fcb5-8a67-4592-8512-8f63d4e5f8ce resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14052024-11-01T22:31:33.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b0f4fcb5-8a67-4592-8512-8f63d4e5f8ce response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14062024-11-01T22:31:34.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bc2ee36-05da-4e8f-927f-9e5aa7696488 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14072024-11-01T22:31:34.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bc2ee36-05da-4e8f-927f-9e5aa7696488 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14082024-11-01T22:31:34.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bc2ee36-05da-4e8f-927f-9e5aa7696488 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14092024-11-01T22:31:35.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd12b849-8e4f-4953-a7dc-92c09c82273c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14102024-11-01T22:31:35.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd12b849-8e4f-4953-a7dc-92c09c82273c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14112024-11-01T22:31:35.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cd12b849-8e4f-4953-a7dc-92c09c82273c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14122024-11-01T22:31:36.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 22850c2e-fcd5-44a4-b082-09e376942800 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14132024-11-01T22:31:36.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 22850c2e-fcd5-44a4-b082-09e376942800 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14142024-11-01T22:31:36.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 22850c2e-fcd5-44a4-b082-09e376942800 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14152024-11-01T22:31:37.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8b75ba24-2de0-4e8a-a143-0f1980438f57 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14162024-11-01T22:31:37.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8b75ba24-2de0-4e8a-a143-0f1980438f57 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14172024-11-01T22:31:37.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8b75ba24-2de0-4e8a-a143-0f1980438f57 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
14182024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
14192024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 26.59\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14202024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
14212024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
14222024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
14232024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14242024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
14252024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14262024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
14272024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
14282024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.11\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
14292024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
14302024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14312024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
14322024-11-01T22:31:38.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
14332024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14342024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.19\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
14352024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
14362024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
14372024-11-01T22:31:38.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:21:38.437299138 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14382024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
14392024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14402024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14412024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
14422024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14432024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14442024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
14452024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
14462024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14472024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14482024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
14492024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14502024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14512024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
14522024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
14532024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14542024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
14552024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
14562024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14572024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
14582024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.061\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
14592024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
14602024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14612024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
14622024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
14632024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14642024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.81\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14652024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
14662024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
14672024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14682024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14692024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14702024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
14712024-11-01T22:31:38.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14722024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14732024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
14742024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
14752024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14762024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14772024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
14782024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14792024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
14802024-11-01T22:31:38.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14812024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14822024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14832024-11-01T22:31:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14842024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14852024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14862024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14872024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14882024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14892024-11-01T22:31:38.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 469637031 } })
14902024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14912024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14922024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14932024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14942024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14952024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14962024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14972024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14982024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14992024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15002024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15012024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15022024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15032024-11-01T22:31:38.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 469736532 } })
15042024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15052024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15062024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15072024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15082024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15092024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15102024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15112024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15122024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15132024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.33058ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15142024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
15152024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.30091ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
15162024-11-01T22:31:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15172024-11-01T22:31:38.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15182024-11-01T22:31:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15192024-11-01T22:31:38.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 472024829 } })
15202024-11-01T22:31:38.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
15212024-11-01T22:31:38.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-11-01T22:31:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.291303ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15232024-11-01T22:31:38.441ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:21:38.437299138 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15242024-11-01T22:31:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.635395ms iteration = 7 status = {"expiration":"2024-11-01T22:21:38.437299138Z","pruned":[]}
15252024-11-01T22:31:38.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15262024-11-01T22:31:38.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15272024-11-01T22:31:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15282024-11-01T22:31:38.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 474722089 } })
15292024-11-01T22:31:38.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
15302024-11-01T22:31:38.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15312024-11-01T22:31:38.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15322024-11-01T22:31:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15332024-11-01T22:31:38.448ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15342024-11-01T22:31:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15352024-11-01T22:31:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15362024-11-01T22:31:38.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15372024-11-01T22:31:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15382024-11-01T22:31:38.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15392024-11-01T22:31:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15402024-11-01T22:31:38.452ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.008854ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
15412024-11-01T22:31:38.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15422024-11-01T22:31:38.455ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15432024-11-01T22:31:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15442024-11-01T22:31:38.458ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15452024-11-01T22:31:38.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15462024-11-01T22:31:38.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15472024-11-01T22:31:38.462ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15482024-11-01T22:31:38.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15492024-11-01T22:31:38.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15502024-11-01T22:31:38.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15512024-11-01T22:31:38.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15522024-11-01T22:31:38.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15532024-11-01T22:31:38.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15542024-11-01T22:31:38.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15552024-11-01T22:31:38.479ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15562024-11-01T22:31:38.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15572024-11-01T22:31:38.480ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15582024-11-01T22:31:38.480ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15592024-11-01T22:31:38.480ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15602024-11-01T22:31:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15612024-11-01T22:31:38.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-11-01T22:31:38.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15632024-11-01T22:31:38.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15642024-11-01T22:31:38.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15652024-11-01T22:31:38.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15662024-11-01T22:31:38.492ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-11-01T22:31:38.493ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682024-11-01T22:31:38.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15692024-11-01T22:31:38.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15702024-11-01T22:31:38.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15712024-11-01T22:31:38.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15722024-11-01T22:31:38.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15732024-11-01T22:31:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15742024-11-01T22:31:38.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15752024-11-01T22:31:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15762024-11-01T22:31:38.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15772024-11-01T22:31:38.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15782024-11-01T22:31:38.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-11-01T22:31:38.496ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15802024-11-01T22:31:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15812024-11-01T22:31:38.496ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15822024-11-01T22:31:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15832024-11-01T22:31:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15842024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15862024-11-01T22:31:38.499ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15872024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.81676ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15882024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15892024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15902024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15912024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15922024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15932024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15942024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15952024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15962024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15972024-11-01T22:31:38.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15982024-11-01T22:31:38.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15992024-11-01T22:31:38.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16002024-11-01T22:31:38.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16012024-11-01T22:31:38.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16022024-11-01T22:31:38.502ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16032024-11-01T22:31:38.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16042024-11-01T22:31:38.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16052024-11-01T22:31:38.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16062024-11-01T22:31:38.507ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 538827926 } })
16072024-11-01T22:31:38.507ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
16082024-11-01T22:31:38.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-11-01T22:31:38.509ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 71.655745ms iteration = 4 status = {"nsuccess":5}
16102024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16112024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16122024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16132024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16142024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
16152024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16162024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16172024-11-01T22:31:38.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16182024-11-01T22:31:38.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16192024-11-01T22:31:38.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16202024-11-01T22:31:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16212024-11-01T22:31:38.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16222024-11-01T22:31:38.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16232024-11-01T22:31:38.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16242024-11-01T22:31:38.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16252024-11-01T22:31:38.519ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16262024-11-01T22:31:38.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16272024-11-01T22:31:38.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16282024-11-01T22:31:38.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16292024-11-01T22:31:38.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16302024-11-01T22:31:38.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16312024-11-01T22:31:38.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16322024-11-01T22:31:38.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332024-11-01T22:31:38.527ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
16342024-11-01T22:31:38.527ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.652212ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
16352024-11-01T22:31:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
16362024-11-01T22:31:38.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16372024-11-01T22:31:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16382024-11-01T22:31:38.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16392024-11-01T22:31:38.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16402024-11-01T22:31:38.528ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16412024-11-01T22:31:38.528ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16422024-11-01T22:31:38.528ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16432024-11-01T22:31:38.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16442024-11-01T22:31:38.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16452024-11-01T22:31:38.529ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.973728ms iteration = 13 status = 0
16462024-11-01T22:31:38.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16472024-11-01T22:31:38.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16482024-11-01T22:31:38.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-11-01T22:31:38.531ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16502024-11-01T22:31:38.531ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16512024-11-01T22:31:38.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16522024-11-01T22:31:38.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16532024-11-01T22:31:38.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16542024-11-01T22:31:38.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16552024-11-01T22:31:38.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16562024-11-01T22:31:38.544ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16572024-11-01T22:31:38.544ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.459059ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16582024-11-01T22:31:38.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.301929ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16592024-11-01T22:31:38.561ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16602024-11-01T22:31:38.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16612024-11-01T22:31:38.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 125.09491ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16622024-11-01T22:31:38.563ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16632024-11-01T22:31:38.563ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16642024-11-01T22:31:38.563ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 126.110478ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16652024-11-01T22:31:38.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16662024-11-01T22:31:38.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16672024-11-01T22:31:38.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16682024-11-01T22:31:38.572ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16692024-11-01T22:31:38.572ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
16702024-11-01T22:31:38.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16712024-11-01T22:31:38.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16722024-11-01T22:31:38.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16732024-11-01T22:31:38.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 64d2b2f4-d6af-4d7b-b222-1c26380e03d3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
16742024-11-01T22:31:38.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 64d2b2f4-d6af-4d7b-b222-1c26380e03d3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
16752024-11-01T22:31:38.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16762024-11-01T22:31:38.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16772024-11-01T22:31:38.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16782024-11-01T22:31:38.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3687 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 64d2b2f4-d6af-4d7b-b222-1c26380e03d3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
16792024-11-01T22:31:38.582ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
16802024-11-01T22:31:38.583ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16812024-11-01T22:31:38.583ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1870418d-71e5-4067-ab2b-f247bf7efcaf", "content-length": "26", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
16822024-11-01T22:31:38.583ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16832024-11-01T22:31:38.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16842024-11-01T22:31:38.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16852024-11-01T22:31:38.586ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16862024-11-01T22:31:38.588ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.205729ms iteration = 16 status = {"physical_disks_added":0}
16872024-11-01T22:31:38.597ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16882024-11-01T22:31:38.597ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16892024-11-01T22:31:38.597ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.566392ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16902024-11-01T22:31:38.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912024-11-01T22:31:38.600ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16922024-11-01T22:31:38.600ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16932024-11-01T22:31:38.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16942024-11-01T22:31:38.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16952024-11-01T22:31:38.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16962024-11-01T22:31:38.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16972024-11-01T22:31:38.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16982024-11-01T22:31:38.661ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16992024-11-01T22:31:38.661ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 224.553256ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17002024-11-01T22:31:38.666ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
17012024-11-01T22:31:38.666ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17022024-11-01T22:31:38.666ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74621102-27b5-4288-896c-cb52324406c2", "content-length": "26", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17032024-11-01T22:31:38.666ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17042024-11-01T22:31:38.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
17052024-11-01T22:31:38.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17062024-11-01T22:31:38.765ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
17072024-11-01T22:31:38.765ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17082024-11-01T22:31:38.765ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee6e58f7-9cc4-4cf8-a7a6-68d84c67c6ed", "content-length": "26", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17092024-11-01T22:31:38.765ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17102024-11-01T22:31:38.767ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17112024-11-01T22:31:38.793ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 355.956984ms iteration = 13 status = {}
17122024-11-01T22:31:38.850ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17132024-11-01T22:31:38.850ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17142024-11-01T22:31:38.851ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "20daa1ab-255c-4b03-8cb5-c2905defeead", "content-length": "372", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17152024-11-01T22:31:38.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17162024-11-01T22:31:38.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17172024-11-01T22:31:38.852ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
17182024-11-01T22:31:38.852ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17192024-11-01T22:31:38.852ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
17202024-11-01T22:31:38.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 415.613417ms iteration = 8 status = {"generation":2}
17212024-11-01T22:31:38.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17222024-11-01T22:31:38.853ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "edf3fd49-6e96-4243-9b68-86b7628ba5c1", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17232024-11-01T22:31:38.853ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17242024-11-01T22:31:38.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252024-11-01T22:31:38.856ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f1782d7f-8672-42af-a8b0-8eec735a371b", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17262024-11-01T22:31:38.856ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17272024-11-01T22:31:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17282024-11-01T22:31:38.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17292024-11-01T22:31:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17302024-11-01T22:31:38.858ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17312024-11-01T22:31:38.858ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 421.204499ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17322024-11-01T22:31:38.860ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17332024-11-01T22:31:38.860ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17342024-11-01T22:31:38.860ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
17352024-11-01T22:31:38.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 423.174434ms iteration = 8 status = {"generation":1}
17362024-11-01T22:31:38.869ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17372024-11-01T22:31:38.886ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17382024-11-01T22:31:38.887ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf04015a-7373-412d-b8e2-57476879b81b", "content-length": "1", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17392024-11-01T22:31:38.888ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17402024-11-01T22:31:38.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17412024-11-01T22:31:38.891ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 453.907948ms iteration = 13 status = null
17422024-11-01T22:31:38.894ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
17432024-11-01T22:31:38.894ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 457.627456ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17442024-11-01T22:31:38.906ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17452024-11-01T22:31:38.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17462024-11-01T22:31:38.907ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3a0e675c-0b5e-45ea-a510-e39ae68c2322", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17472024-11-01T22:31:38.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17482024-11-01T22:31:38.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17492024-11-01T22:31:38.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17502024-11-01T22:31:38.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17512024-11-01T22:31:38.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17522024-11-01T22:31:38.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17532024-11-01T22:31:38.916ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17542024-11-01T22:31:38.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17552024-11-01T22:31:38.917ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c7909d08-b9fa-4449-bd61-1e027b2a9911", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17562024-11-01T22:31:38.918ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 481.052304ms iteration = 14 status = {}
17572024-11-01T22:31:38.933ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17582024-11-01T22:31:38.933ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "60a342a3-f6ce-4d17-a97b-19980959e391", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17592024-11-01T22:31:38.933ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17602024-11-01T22:31:38.934ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5f8afe50-31e9-4fb1-aa95-4e1525b216b7", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17612024-11-01T22:31:38.934ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17622024-11-01T22:31:38.936ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5337f5b4-21e6-434f-ba67-0ae051aff15e", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17632024-11-01T22:31:38.936ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17642024-11-01T22:31:38.938ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17652024-11-01T22:31:38.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 501.504129ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17662024-11-01T22:31:38.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17672024-11-01T22:31:38.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17682024-11-01T22:31:38.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17692024-11-01T22:31:38.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17702024-11-01T22:31:38.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17712024-11-01T22:31:38.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17722024-11-01T22:31:38.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17732024-11-01T22:31:38.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17742024-11-01T22:31:38.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17752024-11-01T22:31:38.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17762024-11-01T22:31:38.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17772024-11-01T22:31:38.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17782024-11-01T22:31:38.965ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
17792024-11-01T22:31:38.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17802024-11-01T22:31:38.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17812024-11-01T22:31:38.974ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17822024-11-01T22:31:38.974ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dcbed67-97e3-44ae-b5dc-ca8f5f339434", "content-length": "134", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17832024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17842024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
17852024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17862024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17872024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17882024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17892024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17902024-11-01T22:31:38.974ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17912024-11-01T22:31:38.975ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17922024-11-01T22:31:38.975ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17932024-11-01T22:31:38.975ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
17942024-11-01T22:31:38.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17952024-11-01T22:31:38.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17962024-11-01T22:31:38.977ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17972024-11-01T22:31:38.977ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a622fe9-947a-4116-bf10-cacc5d544bf3", "content-length": "2", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
17982024-11-01T22:31:38.977ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17992024-11-01T22:31:38.977ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e68df700-9051-4793-8df4-5da09b4f8721", "content-length": "52", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
18002024-11-01T22:31:38.977ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
18012024-11-01T22:31:38.977ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18022024-11-01T22:31:39.059ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18032024-11-01T22:31:39.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9ca51d02-7542-40ff-9117-869c8fcc73fd", "date": "Fri, 01 Nov 2024 22:31:38 GMT"} })
18042024-11-01T22:31:39.088ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
18052024-11-01T22:31:39.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18062024-11-01T22:31:39.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c5346d8-f5bf-4371-bd10-d307fb1bd33c", "content-length": "682", "date": "Fri, 01 Nov 2024 22:31:39 GMT"} })
18072024-11-01T22:31:39.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18082024-11-01T22:31:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18092024-11-01T22:31:39.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ecfe7d3-75e8-44a3-b7ac-2a7a81e3c06a", "content-length": "691", "date": "Fri, 01 Nov 2024 22:31:39 GMT"} })
18102024-11-01T22:31:39.090ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18112024-11-01T22:31:39.090ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18122024-11-01T22:31:39.090ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18132024-11-01T22:31:39.091ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 654.513341ms iteration = 13 status = {}
18142024-11-01T22:31:39.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18152024-11-01T22:31:39.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18162024-11-01T22:31:39.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18172024-11-01T22:31:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18182024-11-01T22:31:39.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18192024-11-01T22:31:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18202024-11-01T22:31:39.109ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.858464ms iteration = 13 status = {}
18212024-11-01T22:31:39.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 59af1d62-281e-40ac-9b80-e82a4bc893ce roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
18222024-11-01T22:31:39.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 59af1d62-281e-40ac-9b80-e82a4bc893ce resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
18232024-11-01T22:31:39.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 59af1d62-281e-40ac-9b80-e82a4bc893ce response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
18242024-11-01T22:31:39.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1cb4502a-36c3-461a-a835-d6fbc0e06750 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18252024-11-01T22:31:39.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1cb4502a-36c3-461a-a835-d6fbc0e06750 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18262024-11-01T22:31:39.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1cb4502a-36c3-461a-a835-d6fbc0e06750 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18272024-11-01T22:31:40.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6d2b3a4-3926-4338-a0ea-a8124cac577f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18282024-11-01T22:31:40.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6d2b3a4-3926-4338-a0ea-a8124cac577f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18292024-11-01T22:31:40.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6d2b3a4-3926-4338-a0ea-a8124cac577f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18302024-11-01T22:31:41.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5ddd1e52-862b-4763-abc8-cf0b03549b01 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18312024-11-01T22:31:41.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5ddd1e52-862b-4763-abc8-cf0b03549b01 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18322024-11-01T22:31:41.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5ddd1e52-862b-4763-abc8-cf0b03549b01 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18332024-11-01T22:31:42.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f21217ce-63b8-4da3-b3db-12e811cc257c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18342024-11-01T22:31:42.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f21217ce-63b8-4da3-b3db-12e811cc257c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18352024-11-01T22:31:42.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f21217ce-63b8-4da3-b3db-12e811cc257c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18362024-11-01T22:31:43.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = bb0bb39f-b712-4210-808e-ea872d639734 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
18372024-11-01T22:31:43.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 480f456c-556e-4d2b-9d61-f76f31c5aeb5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18382024-11-01T22:31:43.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 480f456c-556e-4d2b-9d61-f76f31c5aeb5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18392024-11-01T22:31:43.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 480f456c-556e-4d2b-9d61-f76f31c5aeb5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18402024-11-01T22:31:44.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 028c00bf-43a0-4b87-8310-270a72cbed2a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18412024-11-01T22:31:44.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 028c00bf-43a0-4b87-8310-270a72cbed2a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18422024-11-01T22:31:44.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 028c00bf-43a0-4b87-8310-270a72cbed2a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18432024-11-01T22:31:45.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41c2a329-2533-4c4e-a7fb-a15319fcf289 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18442024-11-01T22:31:45.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41c2a329-2533-4c4e-a7fb-a15319fcf289 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18452024-11-01T22:31:45.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41c2a329-2533-4c4e-a7fb-a15319fcf289 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18462024-11-01T22:31:46.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 95606e80-9e4d-445a-bc2d-18bcdb9b29c2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18472024-11-01T22:31:46.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 95606e80-9e4d-445a-bc2d-18bcdb9b29c2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18482024-11-01T22:31:46.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 95606e80-9e4d-445a-bc2d-18bcdb9b29c2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18492024-11-01T22:31:47.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7c5e6952-af6f-4194-a259-41969a5f3611 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18502024-11-01T22:31:47.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7c5e6952-af6f-4194-a259-41969a5f3611 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18512024-11-01T22:31:47.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7c5e6952-af6f-4194-a259-41969a5f3611 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18522024-11-01T22:31:48.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 15911ca0-625c-4fa3-b301-37a781b64ba7 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
18532024-11-01T22:31:48.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 15911ca0-625c-4fa3-b301-37a781b64ba7 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
18542024-11-01T22:31:48.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 15911ca0-625c-4fa3-b301-37a781b64ba7 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
18552024-11-01T22:31:48.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = c6b3b1a2-fb18-481a-993b-dac6b03cb931 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
18562024-11-01T22:31:48.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = c6b3b1a2-fb18-481a-993b-dac6b03cb931 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
18572024-11-01T22:31:48.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = c6b3b1a2-fb18-481a-993b-dac6b03cb931 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
18582024-11-01T22:31:48.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
18592024-11-01T22:31:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
18602024-11-01T22:31:48.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18612024-11-01T22:31:48.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18622024-11-01T22:31:48.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18632024-11-01T22:31:48.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18642024-11-01T22:31:48.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18652024-11-01T22:31:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18662024-11-01T22:31:48.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18672024-11-01T22:31:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18682024-11-01T22:31:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18692024-11-01T22:31:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702024-11-01T22:31:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18712024-11-01T22:31:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
18722024-11-01T22:31:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18732024-11-01T22:31:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18742024-11-01T22:31:48.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
18752024-11-01T22:31:48.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.501986ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
18762024-11-01T22:31:48.472ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18772024-11-01T22:31:48.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18782024-11-01T22:31:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.218387ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18792024-11-01T22:31:48.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5dfb7d77-6a06-448f-bb2f-bf1fffea1373 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18802024-11-01T22:31:48.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5dfb7d77-6a06-448f-bb2f-bf1fffea1373 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18812024-11-01T22:31:48.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5dfb7d77-6a06-448f-bb2f-bf1fffea1373 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18822024-11-01T22:31:49.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 75bf294d-3274-47da-939f-d55a9822e8d9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18832024-11-01T22:31:49.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 75bf294d-3274-47da-939f-d55a9822e8d9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18842024-11-01T22:31:49.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 75bf294d-3274-47da-939f-d55a9822e8d9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18852024-11-01T22:31:50.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ec0198f-4e16-487f-b74d-096e05f1771f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18862024-11-01T22:31:50.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ec0198f-4e16-487f-b74d-096e05f1771f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18872024-11-01T22:31:50.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ec0198f-4e16-487f-b74d-096e05f1771f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18882024-11-01T22:31:51.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba900df2-a3ba-489c-8de3-483a7452ed8a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18892024-11-01T22:31:51.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba900df2-a3ba-489c-8de3-483a7452ed8a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18902024-11-01T22:31:51.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba900df2-a3ba-489c-8de3-483a7452ed8a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18912024-11-01T22:31:52.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7756382b-3ca8-4649-8c67-1eeb64e205c2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18922024-11-01T22:31:52.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7756382b-3ca8-4649-8c67-1eeb64e205c2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18932024-11-01T22:31:52.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7756382b-3ca8-4649-8c67-1eeb64e205c2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18942024-11-01T22:31:53.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a64a4401-0589-4ff6-b302-47a08bd546d6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18952024-11-01T22:31:53.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a64a4401-0589-4ff6-b302-47a08bd546d6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18962024-11-01T22:31:53.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a64a4401-0589-4ff6-b302-47a08bd546d6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18972024-11-01T22:31:54.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58048373-5fc9-4f07-ac76-a855608d3ac5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18982024-11-01T22:31:54.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58048373-5fc9-4f07-ac76-a855608d3ac5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
18992024-11-01T22:31:54.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58048373-5fc9-4f07-ac76-a855608d3ac5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19002024-11-01T22:31:55.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 37302b56-3109-4735-8ede-6b24c726c7df roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19012024-11-01T22:31:55.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 37302b56-3109-4735-8ede-6b24c726c7df resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19022024-11-01T22:31:55.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 37302b56-3109-4735-8ede-6b24c726c7df response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19032024-11-01T22:31:56.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 36ebb7fd-54ab-48d8-870f-069d82d7b708 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19042024-11-01T22:31:56.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 36ebb7fd-54ab-48d8-870f-069d82d7b708 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19052024-11-01T22:31:56.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 36ebb7fd-54ab-48d8-870f-069d82d7b708 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19062024-11-01T22:31:58.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4fc8800b-9e82-46e0-8bd6-609ef05e23d6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19072024-11-01T22:31:58.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4fc8800b-9e82-46e0-8bd6-609ef05e23d6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19082024-11-01T22:31:58.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4fc8800b-9e82-46e0-8bd6-609ef05e23d6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19092024-11-01T22:31:58.193ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1449 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 682a861f-4089-41a5-9f51-c8e4f8038b38 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
19102024-11-01T22:31:58.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
19112024-11-01T22:31:58.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
19122024-11-01T22:31:58.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19132024-11-01T22:31:58.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19142024-11-01T22:31:58.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19152024-11-01T22:31:58.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19162024-11-01T22:31:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172024-11-01T22:31:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19182024-11-01T22:31:58.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19192024-11-01T22:31:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19202024-11-01T22:31:58.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19212024-11-01T22:31:58.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19222024-11-01T22:31:58.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232024-11-01T22:31:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
19242024-11-01T22:31:58.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19252024-11-01T22:31:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19262024-11-01T22:31:58.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
19272024-11-01T22:31:58.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.306442ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
19282024-11-01T22:31:58.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19292024-11-01T22:31:58.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19302024-11-01T22:31:58.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.267315ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19312024-11-01T22:31:59.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f4800629-e0cc-42c3-9038-3fa40974c65c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19322024-11-01T22:31:59.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f4800629-e0cc-42c3-9038-3fa40974c65c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19332024-11-01T22:31:59.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f4800629-e0cc-42c3-9038-3fa40974c65c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19342024-11-01T22:32:00.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4e98016e-124c-49aa-b002-82a406773fbb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19352024-11-01T22:32:00.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4e98016e-124c-49aa-b002-82a406773fbb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19362024-11-01T22:32:00.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4e98016e-124c-49aa-b002-82a406773fbb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19372024-11-01T22:32:01.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 84295ef6-bef8-4f8f-9df9-3e643ef6c798 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19382024-11-01T22:32:01.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 84295ef6-bef8-4f8f-9df9-3e643ef6c798 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19392024-11-01T22:32:01.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 84295ef6-bef8-4f8f-9df9-3e643ef6c798 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19402024-11-01T22:32:02.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ca6a0ee3-6247-4a28-bb97-3a2d350e407d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19412024-11-01T22:32:02.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ca6a0ee3-6247-4a28-bb97-3a2d350e407d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19422024-11-01T22:32:02.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ca6a0ee3-6247-4a28-bb97-3a2d350e407d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19432024-11-01T22:32:03.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 066ad1db-afdc-4053-9941-870c99b1d228 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19442024-11-01T22:32:03.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 066ad1db-afdc-4053-9941-870c99b1d228 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19452024-11-01T22:32:03.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 066ad1db-afdc-4053-9941-870c99b1d228 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19462024-11-01T22:32:04.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = af0cb38b-602c-4cac-ae8e-e4da2f6d3a2a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19472024-11-01T22:32:04.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = af0cb38b-602c-4cac-ae8e-e4da2f6d3a2a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19482024-11-01T22:32:04.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = af0cb38b-602c-4cac-ae8e-e4da2f6d3a2a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19492024-11-01T22:32:05.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b835be6c-3990-448e-828d-e8608d2aa09e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19502024-11-01T22:32:05.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b835be6c-3990-448e-828d-e8608d2aa09e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19512024-11-01T22:32:05.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b835be6c-3990-448e-828d-e8608d2aa09e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19522024-11-01T22:32:06.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1fa8b7cd-3482-46ea-8982-4f23a99c0a06 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19532024-11-01T22:32:06.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1fa8b7cd-3482-46ea-8982-4f23a99c0a06 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19542024-11-01T22:32:06.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1fa8b7cd-3482-46ea-8982-4f23a99c0a06 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19552024-11-01T22:32:07.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 35951144-985d-43d1-a024-edc823657cfe roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19562024-11-01T22:32:07.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 35951144-985d-43d1-a024-edc823657cfe resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19572024-11-01T22:32:07.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 35951144-985d-43d1-a024-edc823657cfe response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19582024-11-01T22:32:08.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = acc40703-174e-4038-a17e-585a0a8f0395 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19592024-11-01T22:32:08.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = acc40703-174e-4038-a17e-585a0a8f0395 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19602024-11-01T22:32:08.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = acc40703-174e-4038-a17e-585a0a8f0395 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
19612024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
19622024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
19632024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19642024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 19.251\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19652024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19662024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
19672024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
19682024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19692024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19702024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
19712024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
19722024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19732024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.98\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
19742024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
19752024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
19762024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19772024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
19782024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19792024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
19802024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19812024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
19822024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
19832024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
19842024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19852024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19862024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.28\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
19872024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
19882024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
19892024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.64\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19902024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19912024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
19922024-11-01T22:32:08.436ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19932024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
19942024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19952024-11-01T22:32:08.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19962024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19972024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19982024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19992024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20002024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20012024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20022024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20032024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20042024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20052024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20062024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20072024-11-01T22:32:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20082024-11-01T22:32:08.439ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.079023ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20092024-11-01T22:32:08.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20102024-11-01T22:32:08.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 475375344 } })
20112024-11-01T22:32:08.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
20122024-11-01T22:32:08.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20132024-11-01T22:32:08.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20142024-11-01T22:32:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20152024-11-01T22:32:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20162024-11-01T22:32:08.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20172024-11-01T22:32:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20182024-11-01T22:32:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20192024-11-01T22:32:08.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20202024-11-01T22:32:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20212024-11-01T22:32:08.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20222024-11-01T22:32:08.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 479751548 } })
20232024-11-01T22:32:08.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
20242024-11-01T22:32:08.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20252024-11-01T22:32:08.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262024-11-01T22:32:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20272024-11-01T22:32:08.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20282024-11-01T22:32:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20292024-11-01T22:32:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20302024-11-01T22:32:08.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20312024-11-01T22:32:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20322024-11-01T22:32:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20332024-11-01T22:32:08.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20342024-11-01T22:32:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20352024-11-01T22:32:08.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20362024-11-01T22:32:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20372024-11-01T22:32:08.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20382024-11-01T22:32:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20392024-11-01T22:32:08.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20402024-11-01T22:32:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20412024-11-01T22:32:08.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 486888792 } })
20422024-11-01T22:32:08.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
20432024-11-01T22:32:08.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20442024-11-01T22:32:08.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
20452024-11-01T22:32:08.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20462024-11-01T22:32:08.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20472024-11-01T22:32:08.473ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
20482024-11-01T22:32:08.473ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.061841ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
20492024-11-01T22:32:08.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20502024-11-01T22:32:08.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20512024-11-01T22:32:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20522024-11-01T22:32:08.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20532024-11-01T22:32:08.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20542024-11-01T22:32:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20552024-11-01T22:32:08.482ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20562024-11-01T22:32:08.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20572024-11-01T22:32:08.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582024-11-01T22:32:08.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.455508ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20592024-11-01T22:32:08.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20602024-11-01T22:32:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20612024-11-01T22:32:08.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20622024-11-01T22:32:08.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20632024-11-01T22:32:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20642024-11-01T22:32:08.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20652024-11-01T22:32:08.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
20662024-11-01T22:32:08.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20672024-11-01T22:32:08.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20682024-11-01T22:32:08.490ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20692024-11-01T22:32:08.490ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.744939ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20702024-11-01T22:32:08.491ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20712024-11-01T22:32:08.491ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20722024-11-01T22:32:08.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20732024-11-01T22:32:08.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20742024-11-01T22:32:08.491ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.946907ms iteration = 14 status = 0
20752024-11-01T22:32:08.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.548152ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20762024-11-01T22:32:08.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20772024-11-01T22:32:08.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20782024-11-01T22:32:08.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20792024-11-01T22:32:08.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20802024-11-01T22:32:08.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
20812024-11-01T22:32:08.521ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20822024-11-01T22:32:08.521ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80f66e62-ac39-481e-8977-bc04760cd6d7", "content-length": "26", "date": "Fri, 01 Nov 2024 22:32:07 GMT"} })
20832024-11-01T22:32:08.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20842024-11-01T22:32:08.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
20852024-11-01T22:32:08.522ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20862024-11-01T22:32:08.522ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d32313cd-fbff-4d34-9c7b-060008061832", "content-length": "26", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
20872024-11-01T22:32:08.522ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20882024-11-01T22:32:08.523ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20892024-11-01T22:32:08.524ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20902024-11-01T22:32:08.539ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20912024-11-01T22:32:08.539ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20922024-11-01T22:32:08.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20932024-11-01T22:32:08.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20942024-11-01T22:32:08.542ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
20952024-11-01T22:32:08.543ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20962024-11-01T22:32:08.546ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6881c8b8-8dbf-4702-867d-56f466c1f591", "content-length": "26", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
20972024-11-01T22:32:08.546ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20982024-11-01T22:32:08.547ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
20992024-11-01T22:32:08.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21002024-11-01T22:32:08.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21012024-11-01T22:32:08.570ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21022024-11-01T22:32:08.570ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21032024-11-01T22:32:08.570ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.773326ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21042024-11-01T22:32:08.614ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 177.848381ms iteration = 14 status = {}
21052024-11-01T22:32:08.614ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.226494ms iteration = 17 status = {"physical_disks_added":0}
21062024-11-01T22:32:08.621ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21072024-11-01T22:32:08.622ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "647233c3-29c4-4c7d-a22a-5297bbf1e058", "content-length": "1", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21082024-11-01T22:32:08.624ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21092024-11-01T22:32:08.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21102024-11-01T22:32:08.626ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 189.60513ms iteration = 14 status = null
21112024-11-01T22:32:08.636ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21122024-11-01T22:32:08.636ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21132024-11-01T22:32:08.636ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "375592ed-1fc0-434e-a7a0-92987ad2faa7", "content-length": "372", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21142024-11-01T22:32:08.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21152024-11-01T22:32:08.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21162024-11-01T22:32:08.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21172024-11-01T22:32:08.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21182024-11-01T22:32:08.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21192024-11-01T22:32:08.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21202024-11-01T22:32:08.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21212024-11-01T22:32:08.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21222024-11-01T22:32:08.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21232024-11-01T22:32:08.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21242024-11-01T22:32:08.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21252024-11-01T22:32:08.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21262024-11-01T22:32:08.685ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21272024-11-01T22:32:08.685ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21282024-11-01T22:32:08.685ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ebf6f72f-ee4b-463a-b249-869def1a475b", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21292024-11-01T22:32:08.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21302024-11-01T22:32:08.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21312024-11-01T22:32:08.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21322024-11-01T22:32:08.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21332024-11-01T22:32:08.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21342024-11-01T22:32:08.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21352024-11-01T22:32:08.696ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21362024-11-01T22:32:08.696ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21372024-11-01T22:32:08.696ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5fc50f3f-202e-4dc8-817e-0783e9b6019a", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21382024-11-01T22:32:08.698ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.403096ms iteration = 15 status = {}
21392024-11-01T22:32:08.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21402024-11-01T22:32:08.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21412024-11-01T22:32:08.713ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
21422024-11-01T22:32:08.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21432024-11-01T22:32:08.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21442024-11-01T22:32:08.725ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21452024-11-01T22:32:08.726ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "71a303fb-95f7-42a7-b3ce-55607409d3c0", "content-length": "691", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21462024-11-01T22:32:08.726ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21472024-11-01T22:32:08.726ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21482024-11-01T22:32:08.726ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21492024-11-01T22:32:08.728ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.769356ms iteration = 14 status = {}
21502024-11-01T22:32:08.738ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21512024-11-01T22:32:08.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cee1681c-0976-4394-b824-8808488dac96", "content-length": "134", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21522024-11-01T22:32:08.738ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21532024-11-01T22:32:08.738ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
21542024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21552024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21562024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21572024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21582024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21592024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21602024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21612024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21622024-11-01T22:32:08.739ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
21632024-11-01T22:32:08.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21642024-11-01T22:32:08.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21652024-11-01T22:32:08.741ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21662024-11-01T22:32:08.742ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc1a8269-cc25-4ef4-9120-2f4751478dd3", "content-length": "2", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21672024-11-01T22:32:08.742ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21682024-11-01T22:32:08.742ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "84c7040e-338f-4914-810d-06ef555a3687", "content-length": "52", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21692024-11-01T22:32:08.742ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
21702024-11-01T22:32:08.742ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21712024-11-01T22:32:08.868ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8201f9f3-f0cb-4fb4-8f1f-37ffa7dbcc9f", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21722024-11-01T22:32:08.868ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
21732024-11-01T22:32:08.868ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21742024-11-01T22:32:08.868ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "99a59cf2-234b-40fb-91d5-5b505e0d18f1", "content-length": "682", "date": "Fri, 01 Nov 2024 22:32:08 GMT"} })
21752024-11-01T22:32:08.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21762024-11-01T22:32:08.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21772024-11-01T22:32:08.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21782024-11-01T22:32:08.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21792024-11-01T22:32:08.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21802024-11-01T22:32:08.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21812024-11-01T22:32:08.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21822024-11-01T22:32:08.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21832024-11-01T22:32:08.887ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 450.416381ms iteration = 14 status = {}
21842024-11-01T22:32:09.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e7f31287-856c-4e54-bc8b-deb12abe8d11 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21852024-11-01T22:32:09.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e7f31287-856c-4e54-bc8b-deb12abe8d11 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21862024-11-01T22:32:09.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e7f31287-856c-4e54-bc8b-deb12abe8d11 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21872024-11-01T22:32:09.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 5ef7d4a7-2b36-4f63-9ebd-da4d68893795 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21882024-11-01T22:32:09.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 5ef7d4a7-2b36-4f63-9ebd-da4d68893795 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21892024-11-01T22:32:09.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 5ef7d4a7-2b36-4f63-9ebd-da4d68893795 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21902024-11-01T22:32:10.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 03c9a25f-60ec-43ce-ae18-8842756b4dbf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21912024-11-01T22:32:10.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 03c9a25f-60ec-43ce-ae18-8842756b4dbf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21922024-11-01T22:32:10.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 03c9a25f-60ec-43ce-ae18-8842756b4dbf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21932024-11-01T22:32:11.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a86f0149-5d75-423b-87f8-6ae023a494ab roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21942024-11-01T22:32:11.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a86f0149-5d75-423b-87f8-6ae023a494ab resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21952024-11-01T22:32:11.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a86f0149-5d75-423b-87f8-6ae023a494ab response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21962024-11-01T22:32:12.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 91cbd393-579d-4a64-9c1c-1bc2d5bae361 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21972024-11-01T22:32:12.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 91cbd393-579d-4a64-9c1c-1bc2d5bae361 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21982024-11-01T22:32:12.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 91cbd393-579d-4a64-9c1c-1bc2d5bae361 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
21992024-11-01T22:32:13.193ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1495 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = a2f529b6-0e15-4180-9d92-294b14b31c36 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
22002024-11-01T22:32:13.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0a2b5be8-586b-4b06-8f0f-fd525b43343e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22012024-11-01T22:32:13.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0a2b5be8-586b-4b06-8f0f-fd525b43343e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22022024-11-01T22:32:13.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0a2b5be8-586b-4b06-8f0f-fd525b43343e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22032024-11-01T22:32:14.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bbee8589-af8e-48bb-a220-a53c23498d9b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22042024-11-01T22:32:14.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bbee8589-af8e-48bb-a220-a53c23498d9b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22052024-11-01T22:32:14.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bbee8589-af8e-48bb-a220-a53c23498d9b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22062024-11-01T22:32:15.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7f515a74-c7e9-4790-a561-b389336e4166 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22072024-11-01T22:32:15.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7f515a74-c7e9-4790-a561-b389336e4166 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22082024-11-01T22:32:15.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7f515a74-c7e9-4790-a561-b389336e4166 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22092024-11-01T22:32:16.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 023f4935-8aec-4e2d-bae0-07435410cdee roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22102024-11-01T22:32:16.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 023f4935-8aec-4e2d-bae0-07435410cdee resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22112024-11-01T22:32:16.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 023f4935-8aec-4e2d-bae0-07435410cdee response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22122024-11-01T22:32:17.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 74fe95f2-a412-46dc-a4fc-a201bf4d53b4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22132024-11-01T22:32:17.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 74fe95f2-a412-46dc-a4fc-a201bf4d53b4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22142024-11-01T22:32:17.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 74fe95f2-a412-46dc-a4fc-a201bf4d53b4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22152024-11-01T22:32:18.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
22162024-11-01T22:32:18.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
22172024-11-01T22:32:18.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22182024-11-01T22:32:18.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22192024-11-01T22:32:18.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22202024-11-01T22:32:18.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22212024-11-01T22:32:18.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22222024-11-01T22:32:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22232024-11-01T22:32:18.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6a2ed6d6-52fa-4215-96d7-c5de18f7fa14 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22242024-11-01T22:32:18.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6a2ed6d6-52fa-4215-96d7-c5de18f7fa14 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22252024-11-01T22:32:18.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6a2ed6d6-52fa-4215-96d7-c5de18f7fa14 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22262024-11-01T22:32:18.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22272024-11-01T22:32:18.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.428621ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22282024-11-01T22:32:18.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22292024-11-01T22:32:18.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22302024-11-01T22:32:18.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22312024-11-01T22:32:18.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22322024-11-01T22:32:18.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22332024-11-01T22:32:18.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22342024-11-01T22:32:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
22352024-11-01T22:32:18.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22362024-11-01T22:32:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22372024-11-01T22:32:18.512ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
22382024-11-01T22:32:18.512ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.187371ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
22392024-11-01T22:32:19.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f4229d37-9a2f-458e-a4d9-c9e4a6bce438 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22402024-11-01T22:32:19.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f4229d37-9a2f-458e-a4d9-c9e4a6bce438 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22412024-11-01T22:32:19.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f4229d37-9a2f-458e-a4d9-c9e4a6bce438 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22422024-11-01T22:32:20.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8ddba823-5889-4036-933a-dc5c2d072435 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22432024-11-01T22:32:20.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8ddba823-5889-4036-933a-dc5c2d072435 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22442024-11-01T22:32:20.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8ddba823-5889-4036-933a-dc5c2d072435 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22452024-11-01T22:32:21.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a0ee3007-ec3f-40f4-850d-8386e134da83 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22462024-11-01T22:32:21.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a0ee3007-ec3f-40f4-850d-8386e134da83 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22472024-11-01T22:32:21.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a0ee3007-ec3f-40f4-850d-8386e134da83 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22482024-11-01T22:32:22.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef06ed7a-1ea2-4912-b63a-dafa2d26510c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22492024-11-01T22:32:22.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef06ed7a-1ea2-4912-b63a-dafa2d26510c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22502024-11-01T22:32:22.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef06ed7a-1ea2-4912-b63a-dafa2d26510c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22512024-11-01T22:32:23.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce0eb29c-b391-4d6d-8395-8b8589c907ee roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22522024-11-01T22:32:23.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce0eb29c-b391-4d6d-8395-8b8589c907ee resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22532024-11-01T22:32:23.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce0eb29c-b391-4d6d-8395-8b8589c907ee response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22542024-11-01T22:32:24.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5e4480dc-949d-458d-9ea1-c94b437d81e7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22552024-11-01T22:32:24.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5e4480dc-949d-458d-9ea1-c94b437d81e7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22562024-11-01T22:32:24.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5e4480dc-949d-458d-9ea1-c94b437d81e7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22572024-11-01T22:32:25.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0dd29743-89e2-4102-af26-bc1bacf9d2b9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22582024-11-01T22:32:25.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0dd29743-89e2-4102-af26-bc1bacf9d2b9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22592024-11-01T22:32:25.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0dd29743-89e2-4102-af26-bc1bacf9d2b9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22602024-11-01T22:32:26.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 580829bf-75d2-4818-98eb-3934fbd60933 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22612024-11-01T22:32:26.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 580829bf-75d2-4818-98eb-3934fbd60933 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22622024-11-01T22:32:26.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 580829bf-75d2-4818-98eb-3934fbd60933 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22632024-11-01T22:32:27.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 90d59d96-817d-48c5-b99e-7ca090de7766 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22642024-11-01T22:32:27.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 90d59d96-817d-48c5-b99e-7ca090de7766 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22652024-11-01T22:32:27.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 90d59d96-817d-48c5-b99e-7ca090de7766 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22662024-11-01T22:32:28.192ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1346 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 497826a6-bd45-436b-b002-55439ebe6dc0 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
22672024-11-01T22:32:28.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
22682024-11-01T22:32:28.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22692024-11-01T22:32:28.436ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
22702024-11-01T22:32:28.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22712024-11-01T22:32:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22722024-11-01T22:32:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22732024-11-01T22:32:28.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22742024-11-01T22:32:28.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22752024-11-01T22:32:28.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22762024-11-01T22:32:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22772024-11-01T22:32:28.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22782024-11-01T22:32:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22792024-11-01T22:32:28.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22802024-11-01T22:32:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22812024-11-01T22:32:28.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22822024-11-01T22:32:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
22832024-11-01T22:32:28.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22842024-11-01T22:32:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22852024-11-01T22:32:28.455ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
22862024-11-01T22:32:28.455ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.970294ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
22872024-11-01T22:32:28.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.22235ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22882024-11-01T22:32:28.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 395bdb7c-d90d-4604-a992-9d357e7a62d4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22892024-11-01T22:32:28.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 395bdb7c-d90d-4604-a992-9d357e7a62d4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22902024-11-01T22:32:28.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 395bdb7c-d90d-4604-a992-9d357e7a62d4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22912024-11-01T22:32:29.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 69e4a520-bf31-48cc-a61b-b35005ebf91e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22922024-11-01T22:32:29.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 69e4a520-bf31-48cc-a61b-b35005ebf91e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22932024-11-01T22:32:29.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 69e4a520-bf31-48cc-a61b-b35005ebf91e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22942024-11-01T22:32:30.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e73eefc7-a231-4ede-b55d-8312e5c1a1a1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22952024-11-01T22:32:30.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e73eefc7-a231-4ede-b55d-8312e5c1a1a1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22962024-11-01T22:32:30.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e73eefc7-a231-4ede-b55d-8312e5c1a1a1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22972024-11-01T22:32:31.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 905c3670-1f30-4ab8-b8ca-0caa74543887 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22982024-11-01T22:32:31.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 905c3670-1f30-4ab8-b8ca-0caa74543887 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
22992024-11-01T22:32:31.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 905c3670-1f30-4ab8-b8ca-0caa74543887 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23002024-11-01T22:32:32.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef56a700-ffa0-4a6f-8498-6921eb89d35c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23012024-11-01T22:32:32.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef56a700-ffa0-4a6f-8498-6921eb89d35c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23022024-11-01T22:32:32.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef56a700-ffa0-4a6f-8498-6921eb89d35c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23032024-11-01T22:32:33.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = b31f2774-7f7d-4c91-99dd-ec1794fde536 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
23042024-11-01T22:32:33.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = b31f2774-7f7d-4c91-99dd-ec1794fde536 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
23052024-11-01T22:32:33.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = b31f2774-7f7d-4c91-99dd-ec1794fde536 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
23062024-11-01T22:32:33.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 30a57dd3-4de1-4230-bb52-78d16ec66240 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
23072024-11-01T22:32:33.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 30a57dd3-4de1-4230-bb52-78d16ec66240 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
23082024-11-01T22:32:33.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 30a57dd3-4de1-4230-bb52-78d16ec66240 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
23092024-11-01T22:32:33.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f6beb22-daaa-4939-b884-d0c449e9817e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23102024-11-01T22:32:33.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f6beb22-daaa-4939-b884-d0c449e9817e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23112024-11-01T22:32:33.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f6beb22-daaa-4939-b884-d0c449e9817e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23122024-11-01T22:32:34.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 500a2bac-cdfd-4a8d-8476-981b25c91336 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23132024-11-01T22:32:34.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 500a2bac-cdfd-4a8d-8476-981b25c91336 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23142024-11-01T22:32:34.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 500a2bac-cdfd-4a8d-8476-981b25c91336 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23152024-11-01T22:32:35.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d297335a-a4a4-4560-807c-64b7f36a8c5e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23162024-11-01T22:32:35.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d297335a-a4a4-4560-807c-64b7f36a8c5e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23172024-11-01T22:32:35.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d297335a-a4a4-4560-807c-64b7f36a8c5e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23182024-11-01T22:32:36.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b0801af-7f2e-47e4-bcbc-a39a57fe80cf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23192024-11-01T22:32:36.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b0801af-7f2e-47e4-bcbc-a39a57fe80cf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23202024-11-01T22:32:36.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b0801af-7f2e-47e4-bcbc-a39a57fe80cf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23212024-11-01T22:32:37.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 23b20488-685d-4e4c-968a-23438d690943 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23222024-11-01T22:32:37.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 23b20488-685d-4e4c-968a-23438d690943 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23232024-11-01T22:32:37.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 23b20488-685d-4e4c-968a-23438d690943 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
23242024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
23252024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 27.51\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23262024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
23272024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
23282024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23292024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
23302024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23312024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
23322024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23332024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23342024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
23352024-11-01T22:32:38.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23362024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
23372024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23382024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23392024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
23402024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23412024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
23422024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23432024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
23442024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23452024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
23462024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23472024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
23482024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23492024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23502024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
23512024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.669\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
23522024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
23532024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
23542024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23552024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23562024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
23572024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
23582024-11-01T22:32:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.28\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23592024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.01\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
23602024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
23612024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
23622024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
23632024-11-01T22:32:38.438ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23642024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23652024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23662024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23672024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
23682024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
23692024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23702024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
23712024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
23722024-11-01T22:32:38.438ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:22:38.437876288 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23732024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23742024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
23752024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23762024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
23772024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
23782024-11-01T22:32:38.438ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
23792024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.51\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
23802024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
23812024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
23822024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23832024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
23842024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23852024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23862024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23872024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23882024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23892024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23902024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23912024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23922024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23932024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23942024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23952024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23962024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23972024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23982024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23992024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24002024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24012024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24022024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24032024-11-01T22:32:38.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 469487520 } })
24042024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24052024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24062024-11-01T22:32:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24072024-11-01T22:32:38.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 469692741 } })
24082024-11-01T22:32:38.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24092024-11-01T22:32:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.36552ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24102024-11-01T22:32:38.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
24112024-11-01T22:32:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.410881ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
24122024-11-01T22:32:38.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24132024-11-01T22:32:38.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24142024-11-01T22:32:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.441017ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
24152024-11-01T22:32:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.97542ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24162024-11-01T22:32:38.442ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24172024-11-01T22:32:38.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24182024-11-01T22:32:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24192024-11-01T22:32:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24202024-11-01T22:32:38.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24212024-11-01T22:32:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24222024-11-01T22:32:38.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24232024-11-01T22:32:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24242024-11-01T22:32:38.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24252024-11-01T22:32:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24262024-11-01T22:32:38.448ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24272024-11-01T22:32:38.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24282024-11-01T22:32:38.450ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24292024-11-01T22:32:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24302024-11-01T22:32:38.450ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:22:38.437876288 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24312024-11-01T22:32:38.450ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.825078ms iteration = 8 status = {"expiration":"2024-11-01T22:22:38.437876288Z","pruned":[]}
24322024-11-01T22:32:38.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24332024-11-01T22:32:38.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24342024-11-01T22:32:38.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24352024-11-01T22:32:38.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24362024-11-01T22:32:38.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 485820564 } })
24372024-11-01T22:32:38.455ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
24382024-11-01T22:32:38.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 486352708 } })
24392024-11-01T22:32:38.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
24402024-11-01T22:32:38.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 487640988 } })
24412024-11-01T22:32:38.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
24422024-11-01T22:32:38.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24432024-11-01T22:32:38.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24442024-11-01T22:32:38.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24452024-11-01T22:32:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24462024-11-01T22:32:38.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24472024-11-01T22:32:38.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24482024-11-01T22:32:38.474ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24492024-11-01T22:32:38.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24502024-11-01T22:32:38.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24512024-11-01T22:32:38.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24522024-11-01T22:32:38.477ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532024-11-01T22:32:38.479ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24542024-11-01T22:32:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24552024-11-01T22:32:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24562024-11-01T22:32:38.480ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24572024-11-01T22:32:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24582024-11-01T22:32:38.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592024-11-01T22:32:38.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24602024-11-01T22:32:38.490ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24612024-11-01T22:32:38.491ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24622024-11-01T22:32:38.491ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.247315ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24632024-11-01T22:32:38.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24642024-11-01T22:32:38.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24652024-11-01T22:32:38.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24662024-11-01T22:32:38.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24672024-11-01T22:32:38.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24682024-11-01T22:32:38.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24692024-11-01T22:32:38.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24702024-11-01T22:32:38.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24712024-11-01T22:32:38.493ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24722024-11-01T22:32:38.493ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24732024-11-01T22:32:38.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24742024-11-01T22:32:38.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24752024-11-01T22:32:38.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24762024-11-01T22:32:38.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24772024-11-01T22:32:38.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24782024-11-01T22:32:38.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24792024-11-01T22:32:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24802024-11-01T22:32:38.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24812024-11-01T22:32:38.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24822024-11-01T22:32:38.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24832024-11-01T22:32:38.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24842024-11-01T22:32:38.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.644781ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24852024-11-01T22:32:38.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24862024-11-01T22:32:38.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24872024-11-01T22:32:38.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24882024-11-01T22:32:38.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24892024-11-01T22:32:38.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24902024-11-01T22:32:38.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24912024-11-01T22:32:38.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24922024-11-01T22:32:38.506ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24932024-11-01T22:32:38.506ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.317856ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24942024-11-01T22:32:38.515ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-11-01T22:32:38.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24962024-11-01T22:32:38.519ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24972024-11-01T22:32:38.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24982024-11-01T22:32:38.520ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24992024-11-01T22:32:38.520ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25002024-11-01T22:32:38.520ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25012024-11-01T22:32:38.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25022024-11-01T22:32:38.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25032024-11-01T22:32:38.523ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25042024-11-01T22:32:38.523ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25052024-11-01T22:32:38.523ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.807252ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25062024-11-01T22:32:38.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.354973ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25072024-11-01T22:32:38.525ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25082024-11-01T22:32:38.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25092024-11-01T22:32:38.533ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25102024-11-01T22:32:38.533ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25112024-11-01T22:32:38.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25122024-11-01T22:32:38.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25132024-11-01T22:32:38.542ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25142024-11-01T22:32:38.542ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25152024-11-01T22:32:38.542ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25162024-11-01T22:32:38.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25172024-11-01T22:32:38.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25182024-11-01T22:32:38.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-11-01T22:32:38.544ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25202024-11-01T22:32:38.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
25212024-11-01T22:32:38.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25222024-11-01T22:32:38.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25232024-11-01T22:32:38.557ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25242024-11-01T22:32:38.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25252024-11-01T22:32:38.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25262024-11-01T22:32:38.594ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
25272024-11-01T22:32:38.594ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25282024-11-01T22:32:38.594ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ed31933-7d55-4df0-895d-c366216f0efd", "content-length": "26", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
25292024-11-01T22:32:38.594ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25302024-11-01T22:32:38.596ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
25312024-11-01T22:32:38.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
25322024-11-01T22:32:38.610ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25332024-11-01T22:32:38.610ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ac73e99-97c8-47a6-af9c-0479613ddfbd", "content-length": "26", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
25342024-11-01T22:32:38.610ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25352024-11-01T22:32:38.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
25362024-11-01T22:32:38.610ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25372024-11-01T22:32:38.611ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab4bf666-d4ca-44c6-981f-210b9267bad3", "content-length": "26", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
25382024-11-01T22:32:38.611ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25392024-11-01T22:32:38.612ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25402024-11-01T22:32:38.613ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25412024-11-01T22:32:38.639ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25422024-11-01T22:32:38.639ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25432024-11-01T22:32:38.639ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b8f50db-0e07-4914-91af-9144d07a5b84", "content-length": "372", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
25442024-11-01T22:32:38.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25452024-11-01T22:32:38.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25462024-11-01T22:32:38.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25472024-11-01T22:32:38.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25482024-11-01T22:32:38.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25492024-11-01T22:32:38.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25502024-11-01T22:32:38.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25512024-11-01T22:32:38.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25522024-11-01T22:32:38.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25532024-11-01T22:32:38.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
25542024-11-01T22:32:38.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25552024-11-01T22:32:38.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25562024-11-01T22:32:38.653ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 215.619938ms iteration = 15 status = 0
25572024-11-01T22:32:38.661ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
25582024-11-01T22:32:38.661ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 223.362127ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
25592024-11-01T22:32:38.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25602024-11-01T22:32:38.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25612024-11-01T22:32:38.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25622024-11-01T22:32:38.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25632024-11-01T22:32:38.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25642024-11-01T22:32:38.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25652024-11-01T22:32:38.697ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25662024-11-01T22:32:38.697ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25672024-11-01T22:32:38.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 259.911265ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25682024-11-01T22:32:38.722ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25692024-11-01T22:32:38.722ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
25702024-11-01T22:32:38.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25712024-11-01T22:32:38.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25722024-11-01T22:32:38.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25732024-11-01T22:32:38.728ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25742024-11-01T22:32:38.729ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25752024-11-01T22:32:38.729ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "df86f079-7336-4f80-aa50-767818d9de11", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
25762024-11-01T22:32:38.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25772024-11-01T22:32:38.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25782024-11-01T22:32:38.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25792024-11-01T22:32:38.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25802024-11-01T22:32:38.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25812024-11-01T22:32:38.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25822024-11-01T22:32:38.733ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
25832024-11-01T22:32:38.733ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25842024-11-01T22:32:38.733ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
25852024-11-01T22:32:38.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 295.937638ms iteration = 9 status = {"generation":2}
25862024-11-01T22:32:38.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25872024-11-01T22:32:38.735ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25882024-11-01T22:32:38.735ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "009cc2f8-06f6-4ac0-917a-4a3ad5e483f3", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25892024-11-01T22:32:38.735ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25902024-11-01T22:32:38.737ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a31e7172-0993-4174-be92-1d3ca44b99e1", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25912024-11-01T22:32:38.737ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25922024-11-01T22:32:38.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25932024-11-01T22:32:38.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25942024-11-01T22:32:38.739ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25952024-11-01T22:32:38.739ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 301.671812ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25962024-11-01T22:32:38.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25972024-11-01T22:32:38.742ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25982024-11-01T22:32:38.742ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25992024-11-01T22:32:38.743ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ddc15c8c-5890-4bd0-ae41-6feee61562cc", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
26002024-11-01T22:32:38.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26012024-11-01T22:32:38.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26022024-11-01T22:32:38.745ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 307.712228ms iteration = 16 status = {}
26032024-11-01T22:32:38.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26042024-11-01T22:32:38.754ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 316.901538ms iteration = 15 status = {}
26052024-11-01T22:32:38.760ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26062024-11-01T22:32:38.760ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26072024-11-01T22:32:38.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26082024-11-01T22:32:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26092024-11-01T22:32:38.765ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26102024-11-01T22:32:38.766ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa95820b-0aa1-4065-92c4-66da5c6c4333", "content-length": "1", "date": "Fri, 01 Nov 2024 22:32:37 GMT"} })
26112024-11-01T22:32:38.768ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26122024-11-01T22:32:38.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26132024-11-01T22:32:38.776ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 339.217437ms iteration = 15 status = null
26142024-11-01T22:32:38.788ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26152024-11-01T22:32:38.788ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 350.111308ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26162024-11-01T22:32:38.797ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26172024-11-01T22:32:38.806ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
26182024-11-01T22:32:38.806ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 368.765301ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26192024-11-01T22:32:38.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26202024-11-01T22:32:38.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26212024-11-01T22:32:38.815ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 377.9377ms iteration = 18 status = {"physical_disks_added":0}
26222024-11-01T22:32:38.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26232024-11-01T22:32:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26242024-11-01T22:32:38.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26252024-11-01T22:32:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26262024-11-01T22:32:38.825ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26272024-11-01T22:32:38.825ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26282024-11-01T22:32:38.826ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
26292024-11-01T22:32:38.826ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 388.030417ms iteration = 9 status = {"generation":1}
26302024-11-01T22:32:38.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26312024-11-01T22:32:38.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26322024-11-01T22:32:38.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26332024-11-01T22:32:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26342024-11-01T22:32:38.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26352024-11-01T22:32:38.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26362024-11-01T22:32:38.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26372024-11-01T22:32:38.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26382024-11-01T22:32:38.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a954fe1-85b6-4f46-932d-44b75884411f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
26392024-11-01T22:32:38.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a954fe1-85b6-4f46-932d-44b75884411f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
26402024-11-01T22:32:38.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a954fe1-85b6-4f46-932d-44b75884411f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
26412024-11-01T22:32:38.943ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26422024-11-01T22:32:38.944ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "af1df3c7-2295-4503-ae70-37f426ed37b4", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26432024-11-01T22:32:38.944ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26442024-11-01T22:32:38.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d7494a2f-d1f4-4cc9-baae-1f3a5d2191bc", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26452024-11-01T22:32:38.945ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26462024-11-01T22:32:38.947ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4f0ceffa-c241-4aa6-83c9-4f92e052e11f", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26472024-11-01T22:32:38.947ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26482024-11-01T22:32:38.949ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26492024-11-01T22:32:38.949ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 511.875237ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26502024-11-01T22:32:38.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26512024-11-01T22:32:38.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26522024-11-01T22:32:38.978ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
26532024-11-01T22:32:38.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26542024-11-01T22:32:38.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26552024-11-01T22:32:38.998ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26562024-11-01T22:32:38.999ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "783846a4-63e8-4655-848a-e3a853811a1c", "content-length": "691", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
26572024-11-01T22:32:38.999ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26582024-11-01T22:32:38.999ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26592024-11-01T22:32:38.999ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26602024-11-01T22:32:38.999ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 562.293711ms iteration = 15 status = {}
26612024-11-01T22:32:39.008ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26622024-11-01T22:32:39.008ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fac02d8-8fc9-44e0-9792-90567c38df05", "content-length": "134", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
26632024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26642024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
26652024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26662024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26672024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26682024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26692024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26702024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26712024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26722024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26732024-11-01T22:32:39.008ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
26742024-11-01T22:32:39.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26752024-11-01T22:32:39.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26762024-11-01T22:32:39.011ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26772024-11-01T22:32:39.011ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b99f11fe-5cde-4388-b2d7-af1a769adf29", "content-length": "2", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
26782024-11-01T22:32:39.011ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26792024-11-01T22:32:39.011ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9320366-f78c-4555-b98f-089c872f394a", "content-length": "52", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
26802024-11-01T22:32:39.011ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
26812024-11-01T22:32:39.011ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26822024-11-01T22:32:39.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "07ebf0c8-d46f-462b-bb9c-40e5d5f345a3", "date": "Fri, 01 Nov 2024 22:32:38 GMT"} })
26832024-11-01T22:32:39.109ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
26842024-11-01T22:32:39.109ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26852024-11-01T22:32:39.210ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e05f80f-daeb-47b8-826b-09f00cd2d9d9", "content-length": "682", "date": "Fri, 01 Nov 2024 22:32:39 GMT"} })
26862024-11-01T22:32:39.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26872024-11-01T22:32:39.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26882024-11-01T22:32:39.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26892024-11-01T22:32:39.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26902024-11-01T22:32:39.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26912024-11-01T22:32:39.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26922024-11-01T22:32:39.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26932024-11-01T22:32:39.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26942024-11-01T22:32:39.227ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 790.154982ms iteration = 15 status = {}
26952024-11-01T22:32:39.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 8891d0a6-42e7-4312-b6a7-b423484de565 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26962024-11-01T22:32:39.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 8891d0a6-42e7-4312-b6a7-b423484de565 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26972024-11-01T22:32:39.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 8891d0a6-42e7-4312-b6a7-b423484de565 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26982024-11-01T22:32:39.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fac1eefc-0454-4d46-90ef-b124ca08799e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
26992024-11-01T22:32:39.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fac1eefc-0454-4d46-90ef-b124ca08799e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27002024-11-01T22:32:39.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fac1eefc-0454-4d46-90ef-b124ca08799e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27012024-11-01T22:32:40.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3402c37e-90a2-4a21-8a92-b4477efb517f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27022024-11-01T22:32:40.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3402c37e-90a2-4a21-8a92-b4477efb517f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27032024-11-01T22:32:40.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3402c37e-90a2-4a21-8a92-b4477efb517f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27042024-11-01T22:32:41.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bdf16ce-1372-4d3b-8f96-be74efd02a99 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27052024-11-01T22:32:41.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bdf16ce-1372-4d3b-8f96-be74efd02a99 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27062024-11-01T22:32:41.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bdf16ce-1372-4d3b-8f96-be74efd02a99 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27072024-11-01T22:32:43.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53e26d63-7582-4d7e-aba0-089e4e364cd9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27082024-11-01T22:32:43.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53e26d63-7582-4d7e-aba0-089e4e364cd9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27092024-11-01T22:32:43.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53e26d63-7582-4d7e-aba0-089e4e364cd9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27102024-11-01T22:32:43.191ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1463 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 9dc663f7-24b1-4070-86a3-9f62f409bbf1 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
27112024-11-01T22:32:44.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e947ef66-b86d-4676-bfdd-b8d2e691332e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27122024-11-01T22:32:44.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e947ef66-b86d-4676-bfdd-b8d2e691332e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27132024-11-01T22:32:44.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e947ef66-b86d-4676-bfdd-b8d2e691332e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27142024-11-01T22:32:45.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 024314ad-38c5-4097-aab7-cfd67e49c3ef roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27152024-11-01T22:32:45.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 024314ad-38c5-4097-aab7-cfd67e49c3ef resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27162024-11-01T22:32:45.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 024314ad-38c5-4097-aab7-cfd67e49c3ef response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27172024-11-01T22:32:46.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4edf4498-97e1-4a91-b473-9d3032e889d8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27182024-11-01T22:32:46.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4edf4498-97e1-4a91-b473-9d3032e889d8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27192024-11-01T22:32:46.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4edf4498-97e1-4a91-b473-9d3032e889d8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27202024-11-01T22:32:47.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dd0f7b14-7454-47ec-a814-5dc327f3e2cd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27212024-11-01T22:32:47.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dd0f7b14-7454-47ec-a814-5dc327f3e2cd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27222024-11-01T22:32:47.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dd0f7b14-7454-47ec-a814-5dc327f3e2cd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27232024-11-01T22:32:48.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1550e740-d8a6-431b-8280-548d57361cd6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27242024-11-01T22:32:48.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1550e740-d8a6-431b-8280-548d57361cd6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27252024-11-01T22:32:48.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1550e740-d8a6-431b-8280-548d57361cd6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27262024-11-01T22:32:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
27272024-11-01T22:32:48.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
27282024-11-01T22:32:48.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27292024-11-01T22:32:48.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27302024-11-01T22:32:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27312024-11-01T22:32:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27322024-11-01T22:32:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27332024-11-01T22:32:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27342024-11-01T22:32:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27352024-11-01T22:32:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27362024-11-01T22:32:48.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27372024-11-01T22:32:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27382024-11-01T22:32:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27392024-11-01T22:32:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
27402024-11-01T22:32:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27412024-11-01T22:32:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27422024-11-01T22:32:48.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
27432024-11-01T22:32:48.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.029724ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
27442024-11-01T22:32:48.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27452024-11-01T22:32:48.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27462024-11-01T22:32:48.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.898807ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27472024-11-01T22:32:49.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc3a6061-fc33-4923-b939-6bcae851df03 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27482024-11-01T22:32:49.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc3a6061-fc33-4923-b939-6bcae851df03 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27492024-11-01T22:32:49.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc3a6061-fc33-4923-b939-6bcae851df03 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27502024-11-01T22:32:50.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8011b272-dd52-4927-af23-d50855e3568f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27512024-11-01T22:32:50.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8011b272-dd52-4927-af23-d50855e3568f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27522024-11-01T22:32:50.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8011b272-dd52-4927-af23-d50855e3568f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27532024-11-01T22:32:51.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff3f2865-c6bd-443b-8621-9923a8239719 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27542024-11-01T22:32:51.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff3f2865-c6bd-443b-8621-9923a8239719 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27552024-11-01T22:32:51.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff3f2865-c6bd-443b-8621-9923a8239719 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27562024-11-01T22:32:52.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e33336c1-d112-4cc0-a7bb-ebb29bfa4989 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27572024-11-01T22:32:52.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e33336c1-d112-4cc0-a7bb-ebb29bfa4989 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27582024-11-01T22:32:52.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e33336c1-d112-4cc0-a7bb-ebb29bfa4989 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27592024-11-01T22:32:53.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1bb9c9ee-0651-490b-86a0-d733d021e64c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27602024-11-01T22:32:53.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1bb9c9ee-0651-490b-86a0-d733d021e64c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27612024-11-01T22:32:53.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1bb9c9ee-0651-490b-86a0-d733d021e64c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27622024-11-01T22:32:54.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 432b4737-a4cd-4639-a34d-bb40dcc134f6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27632024-11-01T22:32:54.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 432b4737-a4cd-4639-a34d-bb40dcc134f6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27642024-11-01T22:32:54.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 432b4737-a4cd-4639-a34d-bb40dcc134f6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27652024-11-01T22:32:55.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c2b3e4f8-dbfc-49fc-bdaf-993020ffdea8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27662024-11-01T22:32:55.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c2b3e4f8-dbfc-49fc-bdaf-993020ffdea8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27672024-11-01T22:32:55.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c2b3e4f8-dbfc-49fc-bdaf-993020ffdea8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27682024-11-01T22:32:56.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fc5792d7-2077-425a-a52e-f38f92bafb2a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27692024-11-01T22:32:56.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fc5792d7-2077-425a-a52e-f38f92bafb2a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27702024-11-01T22:32:56.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fc5792d7-2077-425a-a52e-f38f92bafb2a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27712024-11-01T22:32:57.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b06578a-257e-4ec8-ac82-5707816ba86b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27722024-11-01T22:32:57.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b06578a-257e-4ec8-ac82-5707816ba86b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27732024-11-01T22:32:57.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b06578a-257e-4ec8-ac82-5707816ba86b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27742024-11-01T22:32:58.193ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = b808755c-e6c9-44f1-8c54-aae2a076f38a response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
27752024-11-01T22:32:58.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3a6b5df-ef0f-4cdb-9960-bb700e78dbe5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27762024-11-01T22:32:58.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3a6b5df-ef0f-4cdb-9960-bb700e78dbe5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27772024-11-01T22:32:58.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3a6b5df-ef0f-4cdb-9960-bb700e78dbe5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
27782024-11-01T22:32:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
27792024-11-01T22:32:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27802024-11-01T22:32:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
27812024-11-01T22:32:58.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27822024-11-01T22:32:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27832024-11-01T22:32:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27842024-11-01T22:32:58.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27852024-11-01T22:32:58.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27862024-11-01T22:32:58.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27872024-11-01T22:32:58.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27882024-11-01T22:32:58.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27892024-11-01T22:32:58.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27902024-11-01T22:32:58.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27912024-11-01T22:32:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27922024-11-01T22:32:58.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932024-11-01T22:32:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
27942024-11-01T22:32:58.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27952024-11-01T22:32:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27962024-11-01T22:32:58.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
27972024-11-01T22:32:58.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.33857ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
27982024-11-01T22:32:58.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.157829ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27992024-11-01T22:32:59.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e6e279f3-4a02-4207-bec8-483640c8e8ef roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28002024-11-01T22:32:59.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e6e279f3-4a02-4207-bec8-483640c8e8ef resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28012024-11-01T22:32:59.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e6e279f3-4a02-4207-bec8-483640c8e8ef response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28022024-11-01T22:33:00.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6fa3d52-d5df-4f2b-a6e4-503478133cb6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28032024-11-01T22:33:00.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6fa3d52-d5df-4f2b-a6e4-503478133cb6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28042024-11-01T22:33:00.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6fa3d52-d5df-4f2b-a6e4-503478133cb6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28052024-11-01T22:33:01.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f688f6fb-fbf6-45b0-bfc7-733bb10e2d54 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28062024-11-01T22:33:01.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f688f6fb-fbf6-45b0-bfc7-733bb10e2d54 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28072024-11-01T22:33:01.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f688f6fb-fbf6-45b0-bfc7-733bb10e2d54 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28082024-11-01T22:33:02.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51d65e7b-bd57-4236-9f05-89111488ddfd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28092024-11-01T22:33:02.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51d65e7b-bd57-4236-9f05-89111488ddfd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28102024-11-01T22:33:02.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51d65e7b-bd57-4236-9f05-89111488ddfd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28112024-11-01T22:33:03.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8f54e393-26db-4f55-ae7b-b5a5781659dd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28122024-11-01T22:33:03.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8f54e393-26db-4f55-ae7b-b5a5781659dd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28132024-11-01T22:33:03.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8f54e393-26db-4f55-ae7b-b5a5781659dd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28142024-11-01T22:33:04.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e99b222-2c77-443b-a48e-6205f56d874e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28152024-11-01T22:33:04.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e99b222-2c77-443b-a48e-6205f56d874e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28162024-11-01T22:33:04.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e99b222-2c77-443b-a48e-6205f56d874e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28172024-11-01T22:33:05.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 475a5f21-1f5f-442c-ac9b-21ebc7256c96 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28182024-11-01T22:33:05.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 475a5f21-1f5f-442c-ac9b-21ebc7256c96 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28192024-11-01T22:33:05.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 475a5f21-1f5f-442c-ac9b-21ebc7256c96 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28202024-11-01T22:33:06.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a1463942-0c29-4509-9f20-04df8e960b95 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28212024-11-01T22:33:06.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a1463942-0c29-4509-9f20-04df8e960b95 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28222024-11-01T22:33:06.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a1463942-0c29-4509-9f20-04df8e960b95 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28232024-11-01T22:33:07.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1f5e26a8-910c-46ef-9e14-361f5ae8165c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28242024-11-01T22:33:07.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1f5e26a8-910c-46ef-9e14-361f5ae8165c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28252024-11-01T22:33:07.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1f5e26a8-910c-46ef-9e14-361f5ae8165c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
28262024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
28272024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 21.591\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
28282024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
28292024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
28302024-11-01T22:33:08.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28312024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28322024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
28332024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28342024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
28352024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28362024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
28372024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28382024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28392024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
28402024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.83\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
28412024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
28422024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
28432024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28442024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28452024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
28462024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28472024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
28482024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.32\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
28492024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
28502024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28512024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
28522024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28532024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
28542024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.391\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
28552024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28562024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
28572024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
28582024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28592024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
28602024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28612024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28622024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28632024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28642024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28652024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28662024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28672024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28682024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28692024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28702024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28712024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28722024-11-01T22:33:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28732024-11-01T22:33:08.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28742024-11-01T22:33:08.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 471460565 } })
28752024-11-01T22:33:08.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
28762024-11-01T22:33:08.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.754248ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28772024-11-01T22:33:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28782024-11-01T22:33:08.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28792024-11-01T22:33:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28802024-11-01T22:33:08.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28812024-11-01T22:33:08.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28822024-11-01T22:33:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28832024-11-01T22:33:08.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28842024-11-01T22:33:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28852024-11-01T22:33:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28862024-11-01T22:33:08.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28872024-11-01T22:33:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28882024-11-01T22:33:08.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 479501366 } })
28892024-11-01T22:33:08.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
28902024-11-01T22:33:08.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28912024-11-01T22:33:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28922024-11-01T22:33:08.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 481742113 } })
28932024-11-01T22:33:08.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
28942024-11-01T22:33:08.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28952024-11-01T22:33:08.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28962024-11-01T22:33:08.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28972024-11-01T22:33:08.479ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28982024-11-01T22:33:08.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28992024-11-01T22:33:08.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29002024-11-01T22:33:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29012024-11-01T22:33:08.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29022024-11-01T22:33:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29032024-11-01T22:33:08.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29042024-11-01T22:33:08.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29052024-11-01T22:33:08.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.068247ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29062024-11-01T22:33:08.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29072024-11-01T22:33:08.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29082024-11-01T22:33:08.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29092024-11-01T22:33:08.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29102024-11-01T22:33:08.482ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112024-11-01T22:33:08.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29122024-11-01T22:33:08.483ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29132024-11-01T22:33:08.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29142024-11-01T22:33:08.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152024-11-01T22:33:08.485ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29162024-11-01T22:33:08.485ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29172024-11-01T22:33:08.485ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29182024-11-01T22:33:08.485ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29192024-11-01T22:33:08.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29202024-11-01T22:33:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
29212024-11-01T22:33:08.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29222024-11-01T22:33:08.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29232024-11-01T22:33:08.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29242024-11-01T22:33:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29252024-11-01T22:33:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29262024-11-01T22:33:08.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29272024-11-01T22:33:08.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29282024-11-01T22:33:08.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29292024-11-01T22:33:08.488ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29302024-11-01T22:33:08.488ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.685305ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29312024-11-01T22:33:08.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.235629ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29322024-11-01T22:33:08.490ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.012005ms iteration = 16 status = 0
29332024-11-01T22:33:08.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29342024-11-01T22:33:08.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29352024-11-01T22:33:08.512ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
29362024-11-01T22:33:08.512ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29372024-11-01T22:33:08.512ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46ca7b46-c902-4f9c-8bcf-9627bc4e248e", "content-length": "26", "date": "Fri, 01 Nov 2024 22:33:07 GMT"} })
29382024-11-01T22:33:08.512ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29392024-11-01T22:33:08.514ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29402024-11-01T22:33:08.524ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29412024-11-01T22:33:08.524ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29422024-11-01T22:33:08.524ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29432024-11-01T22:33:08.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
29442024-11-01T22:33:08.524ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29452024-11-01T22:33:08.524ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e17a70f-b644-437e-882c-7478261a729e", "content-length": "26", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
29462024-11-01T22:33:08.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29472024-11-01T22:33:08.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29482024-11-01T22:33:08.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29492024-11-01T22:33:08.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-11-01T22:33:08.527ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
29512024-11-01T22:33:08.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29522024-11-01T22:33:08.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29532024-11-01T22:33:08.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29542024-11-01T22:33:08.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
29552024-11-01T22:33:08.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29562024-11-01T22:33:08.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29572024-11-01T22:33:08.534ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
29582024-11-01T22:33:08.534ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29592024-11-01T22:33:08.534ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c857ba1-db7a-4547-b352-362cd277890d", "content-length": "26", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
29602024-11-01T22:33:08.534ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29612024-11-01T22:33:08.535ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29622024-11-01T22:33:08.544ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
29632024-11-01T22:33:08.544ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.71576ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
29642024-11-01T22:33:08.556ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29652024-11-01T22:33:08.556ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29662024-11-01T22:33:08.556ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.217618ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29672024-11-01T22:33:08.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29682024-11-01T22:33:08.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29692024-11-01T22:33:08.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fc16e22a-f553-488e-8afb-531f45530c7b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
29702024-11-01T22:33:08.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fc16e22a-f553-488e-8afb-531f45530c7b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
29712024-11-01T22:33:08.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fc16e22a-f553-488e-8afb-531f45530c7b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
29722024-11-01T22:33:08.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29732024-11-01T22:33:08.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29742024-11-01T22:33:08.640ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.851303ms iteration = 16 status = {}
29752024-11-01T22:33:08.641ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 202.79405ms iteration = 19 status = {"physical_disks_added":0}
29762024-11-01T22:33:08.664ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29772024-11-01T22:33:08.664ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29782024-11-01T22:33:08.664ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f03ca1a-dab6-4397-add3-07101c142067", "content-length": "372", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
29792024-11-01T22:33:08.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29802024-11-01T22:33:08.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29812024-11-01T22:33:08.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29822024-11-01T22:33:08.667ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29832024-11-01T22:33:08.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29842024-11-01T22:33:08.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29852024-11-01T22:33:08.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29862024-11-01T22:33:08.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29872024-11-01T22:33:08.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29882024-11-01T22:33:08.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29892024-11-01T22:33:08.709ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29902024-11-01T22:33:08.709ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29912024-11-01T22:33:08.709ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f0c44e0c-e112-4720-a2f9-d3e58f04c8fb", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
29922024-11-01T22:33:08.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29932024-11-01T22:33:08.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29942024-11-01T22:33:08.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29952024-11-01T22:33:08.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29962024-11-01T22:33:08.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29972024-11-01T22:33:08.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29982024-11-01T22:33:08.720ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29992024-11-01T22:33:08.720ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30002024-11-01T22:33:08.720ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "67853c28-e954-436a-93d8-e10a7df66c1c", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30012024-11-01T22:33:08.723ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.186747ms iteration = 17 status = {}
30022024-11-01T22:33:08.745ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30032024-11-01T22:33:08.745ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f03c9b9-4474-40a0-9c71-f4a4fd452a2b", "content-length": "1", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30042024-11-01T22:33:08.747ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30052024-11-01T22:33:08.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30062024-11-01T22:33:08.762ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30072024-11-01T22:33:08.762ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f062e7d5-c201-4d92-8aae-13fe6d61e5ce", "content-length": "691", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30082024-11-01T22:33:08.762ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30092024-11-01T22:33:08.762ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30102024-11-01T22:33:08.762ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30112024-11-01T22:33:08.763ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 325.371472ms iteration = 16 status = {}
30122024-11-01T22:33:08.763ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.456822ms iteration = 16 status = null
30132024-11-01T22:33:08.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30142024-11-01T22:33:08.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30152024-11-01T22:33:08.810ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
30162024-11-01T22:33:08.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30172024-11-01T22:33:08.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30182024-11-01T22:33:08.820ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30192024-11-01T22:33:08.820ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eb1999d-ca5e-4598-b7e9-884672983d64", "content-length": "134", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30202024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30212024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
30222024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30232024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30242024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30252024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30262024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30272024-11-01T22:33:08.820ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30282024-11-01T22:33:08.821ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30292024-11-01T22:33:08.821ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30302024-11-01T22:33:08.821ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
30312024-11-01T22:33:08.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30322024-11-01T22:33:08.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30332024-11-01T22:33:08.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30342024-11-01T22:33:08.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "562af9db-3ce2-47fd-a6d9-462d52435092", "content-length": "2", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30352024-11-01T22:33:08.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30362024-11-01T22:33:08.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8016829c-aac9-4571-9674-ea6ac9bb1fa5", "content-length": "52", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30372024-11-01T22:33:08.823ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
30382024-11-01T22:33:08.823ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30392024-11-01T22:33:08.928ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79f4fc81-770e-4769-ad13-756d2ab07747", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30402024-11-01T22:33:08.928ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
30412024-11-01T22:33:08.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30422024-11-01T22:33:08.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "abbd0fb1-6d4f-41a2-b611-598bf36046f9", "content-length": "682", "date": "Fri, 01 Nov 2024 22:33:08 GMT"} })
30432024-11-01T22:33:08.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30442024-11-01T22:33:08.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30452024-11-01T22:33:08.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30462024-11-01T22:33:08.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30472024-11-01T22:33:08.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30482024-11-01T22:33:08.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30492024-11-01T22:33:08.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30502024-11-01T22:33:08.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30512024-11-01T22:33:08.945ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 506.977231ms iteration = 16 status = {}
30522024-11-01T22:33:09.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0dcab89d-9c61-4c77-9362-d2a0f8522fb0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30532024-11-01T22:33:09.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0dcab89d-9c61-4c77-9362-d2a0f8522fb0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30542024-11-01T22:33:09.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0dcab89d-9c61-4c77-9362-d2a0f8522fb0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30552024-11-01T22:33:09.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 3b2f1f80-4d46-4fc4-8b6b-fb1712ffed50 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
30562024-11-01T22:33:09.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 3b2f1f80-4d46-4fc4-8b6b-fb1712ffed50 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30572024-11-01T22:33:09.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 3b2f1f80-4d46-4fc4-8b6b-fb1712ffed50 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30582024-11-01T22:33:10.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e20477ff-56fe-44fd-a3b8-950376d22352 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30592024-11-01T22:33:10.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e20477ff-56fe-44fd-a3b8-950376d22352 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30602024-11-01T22:33:10.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e20477ff-56fe-44fd-a3b8-950376d22352 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30612024-11-01T22:33:11.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d6de8e0-c798-412f-92f2-a43fb1afd3c9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30622024-11-01T22:33:11.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d6de8e0-c798-412f-92f2-a43fb1afd3c9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30632024-11-01T22:33:11.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d6de8e0-c798-412f-92f2-a43fb1afd3c9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30642024-11-01T22:33:12.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 06cee009-a593-47c4-a832-d8c0732ea061 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30652024-11-01T22:33:12.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 06cee009-a593-47c4-a832-d8c0732ea061 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30662024-11-01T22:33:12.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 06cee009-a593-47c4-a832-d8c0732ea061 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30672024-11-01T22:33:13.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1481 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 4c41e5eb-0050-46f2-97b4-d194d9b41e9d response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
30682024-11-01T22:33:13.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00d5267e-8766-4354-9c52-d040f42f4a04 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30692024-11-01T22:33:13.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00d5267e-8766-4354-9c52-d040f42f4a04 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30702024-11-01T22:33:13.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00d5267e-8766-4354-9c52-d040f42f4a04 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30712024-11-01T22:33:14.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 664d79ab-028d-425e-ab2d-087089dbd89f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30722024-11-01T22:33:14.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 664d79ab-028d-425e-ab2d-087089dbd89f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30732024-11-01T22:33:14.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 664d79ab-028d-425e-ab2d-087089dbd89f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30742024-11-01T22:33:15.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6a4fce4-6c65-41f5-9b38-32af073fea28 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30752024-11-01T22:33:15.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6a4fce4-6c65-41f5-9b38-32af073fea28 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30762024-11-01T22:33:15.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6a4fce4-6c65-41f5-9b38-32af073fea28 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30772024-11-01T22:33:16.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e2f1e2c-4cb9-4d6f-b0bd-b1d34a24056e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30782024-11-01T22:33:16.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e2f1e2c-4cb9-4d6f-b0bd-b1d34a24056e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30792024-11-01T22:33:16.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e2f1e2c-4cb9-4d6f-b0bd-b1d34a24056e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30802024-11-01T22:33:17.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63e45093-4038-472f-b996-9e20a6b325a8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30812024-11-01T22:33:17.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63e45093-4038-472f-b996-9e20a6b325a8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30822024-11-01T22:33:17.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63e45093-4038-472f-b996-9e20a6b325a8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
30832024-11-01T22:33:18.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
30842024-11-01T22:33:18.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
30852024-11-01T22:33:18.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30862024-11-01T22:33:18.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30872024-11-01T22:33:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30882024-11-01T22:33:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30892024-11-01T22:33:18.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30902024-11-01T22:33:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30912024-11-01T22:33:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30922024-11-01T22:33:18.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.515647ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30932024-11-01T22:33:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30942024-11-01T22:33:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30952024-11-01T22:33:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30962024-11-01T22:33:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30972024-11-01T22:33:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30982024-11-01T22:33:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30992024-11-01T22:33:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
31002024-11-01T22:33:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31012024-11-01T22:33:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31022024-11-01T22:33:18.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
31032024-11-01T22:33:18.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.230684ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
31042024-11-01T22:33:18.560ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:55220
31052024-11-01T22:33:18.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55220 req_id = 80c5c924-3c53-447f-8c17-01431fdf3b25 roles = RoleSet { roles: {} } uri = /metrics/producers
31062024-11-01T22:33:18.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55220 req_id = 80c5c924-3c53-447f-8c17-01431fdf3b25 resource = Database result = Ok(()) uri = /metrics/producers
31072024-11-01T22:33:18.597ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = eb6325c7-d1c1-4d78-89ec-4210cb4d49a2
31082024-11-01T22:33:18.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36361 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55220 req_id = 80c5c924-3c53-447f-8c17-01431fdf3b25 response_code = 201 uri = /metrics/producers
31092024-11-01T22:33:18.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2f604bfb-5921-48f1-b0a5-fa9f036b59e2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31102024-11-01T22:33:18.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2f604bfb-5921-48f1-b0a5-fa9f036b59e2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31112024-11-01T22:33:18.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2f604bfb-5921-48f1-b0a5-fa9f036b59e2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31122024-11-01T22:33:19.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c3c89b4c-52c3-4d5f-9482-ad2ce94dcb35 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31132024-11-01T22:33:19.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c3c89b4c-52c3-4d5f-9482-ad2ce94dcb35 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31142024-11-01T22:33:19.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c3c89b4c-52c3-4d5f-9482-ad2ce94dcb35 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31152024-11-01T22:33:20.619ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45781
31162024-11-01T22:33:20.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45781 req_id = 5f2f1e48-3812-4ffc-b089-7f85ae9ed4dd roles = RoleSet { roles: {} } uri = /metrics/producers
31172024-11-01T22:33:20.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45781 req_id = 5f2f1e48-3812-4ffc-b089-7f85ae9ed4dd resource = Database result = Ok(()) uri = /metrics/producers
31182024-11-01T22:33:20.661ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 0c64e418-1894-441d-86b0-7394a1124e4a
31192024-11-01T22:33:20.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42519 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45781 req_id = 5f2f1e48-3812-4ffc-b089-7f85ae9ed4dd response_code = 201 uri = /metrics/producers
31202024-11-01T22:33:20.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d37dd249-a4b0-430f-b499-f700ad6c11a6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31212024-11-01T22:33:20.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d37dd249-a4b0-430f-b499-f700ad6c11a6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31222024-11-01T22:33:20.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d37dd249-a4b0-430f-b499-f700ad6c11a6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31232024-11-01T22:33:21.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a34435c5-3b78-4cdf-bdcd-8d3e843f738c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31242024-11-01T22:33:21.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a34435c5-3b78-4cdf-bdcd-8d3e843f738c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31252024-11-01T22:33:21.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a34435c5-3b78-4cdf-bdcd-8d3e843f738c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31262024-11-01T22:33:22.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 10f5715a-d491-4564-9ce0-57e2162d42aa roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31272024-11-01T22:33:22.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 10f5715a-d491-4564-9ce0-57e2162d42aa resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31282024-11-01T22:33:22.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 10f5715a-d491-4564-9ce0-57e2162d42aa response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31292024-11-01T22:33:23.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d0cdf6f5-2585-4c03-bf28-94f2b5686755 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31302024-11-01T22:33:23.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d0cdf6f5-2585-4c03-bf28-94f2b5686755 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31312024-11-01T22:33:23.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d0cdf6f5-2585-4c03-bf28-94f2b5686755 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31322024-11-01T22:33:24.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d1e80d1e-6ed9-404a-87dd-ee783b1ea822 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31332024-11-01T22:33:24.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d1e80d1e-6ed9-404a-87dd-ee783b1ea822 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31342024-11-01T22:33:24.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d1e80d1e-6ed9-404a-87dd-ee783b1ea822 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31352024-11-01T22:33:25.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e56da1fe-d0ba-499b-b584-46dca8ab1e7e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31362024-11-01T22:33:25.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e56da1fe-d0ba-499b-b584-46dca8ab1e7e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31372024-11-01T22:33:25.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e56da1fe-d0ba-499b-b584-46dca8ab1e7e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31382024-11-01T22:33:27.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 49a25c90-c890-4650-9ffb-3b25193def08 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31392024-11-01T22:33:27.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 49a25c90-c890-4650-9ffb-3b25193def08 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31402024-11-01T22:33:27.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 49a25c90-c890-4650-9ffb-3b25193def08 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31412024-11-01T22:33:28.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41fd19f7-be6e-4682-b7d8-e7a2bc98b213 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31422024-11-01T22:33:28.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41fd19f7-be6e-4682-b7d8-e7a2bc98b213 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31432024-11-01T22:33:28.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41fd19f7-be6e-4682-b7d8-e7a2bc98b213 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31442024-11-01T22:33:28.193ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 83cdce64-1b7f-4d37-9cf4-3019ee251af7 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
31452024-11-01T22:33:28.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
31462024-11-01T22:33:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
31472024-11-01T22:33:28.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31482024-11-01T22:33:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31492024-11-01T22:33:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31502024-11-01T22:33:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31512024-11-01T22:33:28.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522024-11-01T22:33:28.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31532024-11-01T22:33:28.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31542024-11-01T22:33:28.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.160752ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31552024-11-01T22:33:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31562024-11-01T22:33:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31572024-11-01T22:33:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31582024-11-01T22:33:28.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31592024-11-01T22:33:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31602024-11-01T22:33:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612024-11-01T22:33:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
31622024-11-01T22:33:28.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31632024-11-01T22:33:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31642024-11-01T22:33:28.455ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
31652024-11-01T22:33:28.455ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.833516ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
31662024-11-01T22:33:29.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a3743f4e-822e-4870-9f90-44cb0779de99 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31672024-11-01T22:33:29.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a3743f4e-822e-4870-9f90-44cb0779de99 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31682024-11-01T22:33:29.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a3743f4e-822e-4870-9f90-44cb0779de99 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31692024-11-01T22:33:30.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df5efe60-e529-415b-bbf5-4c11e642fde8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31702024-11-01T22:33:30.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df5efe60-e529-415b-bbf5-4c11e642fde8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31712024-11-01T22:33:30.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df5efe60-e529-415b-bbf5-4c11e642fde8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31722024-11-01T22:33:31.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ae9741d-4e2f-42e5-b614-628ed898600b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31732024-11-01T22:33:31.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ae9741d-4e2f-42e5-b614-628ed898600b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31742024-11-01T22:33:31.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ae9741d-4e2f-42e5-b614-628ed898600b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31752024-11-01T22:33:32.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ed985966-ee07-4fae-8530-c0a4c7f6db73 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31762024-11-01T22:33:32.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ed985966-ee07-4fae-8530-c0a4c7f6db73 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31772024-11-01T22:33:32.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ed985966-ee07-4fae-8530-c0a4c7f6db73 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31782024-11-01T22:33:33.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 33548ecf-feb7-4a81-ab4d-6c6362467779 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31792024-11-01T22:33:33.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 33548ecf-feb7-4a81-ab4d-6c6362467779 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31802024-11-01T22:33:33.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 33548ecf-feb7-4a81-ab4d-6c6362467779 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31812024-11-01T22:33:33.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = b0224e0f-0d3d-4888-9440-a46211794cc3 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
31822024-11-01T22:33:33.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = b0224e0f-0d3d-4888-9440-a46211794cc3 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
31832024-11-01T22:33:33.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = b0224e0f-0d3d-4888-9440-a46211794cc3 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
31842024-11-01T22:33:33.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 7a712b08-ab6a-4dd8-919a-05b42c360c64 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
31852024-11-01T22:33:33.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 7a712b08-ab6a-4dd8-919a-05b42c360c64 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
31862024-11-01T22:33:33.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 7a712b08-ab6a-4dd8-919a-05b42c360c64 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
31872024-11-01T22:33:34.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e90ee390-f652-4000-b205-53df5c2fd3bb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31882024-11-01T22:33:34.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e90ee390-f652-4000-b205-53df5c2fd3bb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31892024-11-01T22:33:34.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e90ee390-f652-4000-b205-53df5c2fd3bb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31902024-11-01T22:33:35.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a0c3ad03-dc0a-4d97-a853-34510d858ebe roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31912024-11-01T22:33:35.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a0c3ad03-dc0a-4d97-a853-34510d858ebe resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31922024-11-01T22:33:35.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a0c3ad03-dc0a-4d97-a853-34510d858ebe response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31932024-11-01T22:33:36.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ed833959-9632-4ce6-a323-d52053d87410 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31942024-11-01T22:33:36.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ed833959-9632-4ce6-a323-d52053d87410 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31952024-11-01T22:33:36.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ed833959-9632-4ce6-a323-d52053d87410 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31962024-11-01T22:33:37.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 19506a5e-bfab-4978-93e8-bb95b17a6ec7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31972024-11-01T22:33:37.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 19506a5e-bfab-4978-93e8-bb95b17a6ec7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31982024-11-01T22:33:37.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 19506a5e-bfab-4978-93e8-bb95b17a6ec7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
31992024-11-01T22:33:38.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e01e47b-4a57-4bf4-9a77-64f056e8d087 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
32002024-11-01T22:33:38.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e01e47b-4a57-4bf4-9a77-64f056e8d087 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
32012024-11-01T22:33:38.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e01e47b-4a57-4bf4-9a77-64f056e8d087 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
32022024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
32032024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
32042024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
32052024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32062024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32072024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
32082024-11-01T22:33:38.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32092024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
32102024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32112024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32122024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32132024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
32142024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
32152024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
32162024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
32172024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32182024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
32192024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32202024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32212024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32222024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
32232024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32242024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32252024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
32262024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
32272024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32282024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32292024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
32302024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
32312024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
32322024-11-01T22:33:38.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32332024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
32342024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32352024-11-01T22:33:38.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:23:38.437825842 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32362024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32372024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
32382024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32392024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
32402024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.13\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32412024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
32422024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
32432024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
32442024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.87\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
32452024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.8\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
32462024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.6\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
32472024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
32482024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
32492024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
32502024-11-01T22:33:38.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32512024-11-01T22:33:38.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
32522024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.21\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
32532024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
32542024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
32552024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32562024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
32572024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32582024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
32592024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32602024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32612024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32622024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
32632024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32642024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32652024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32662024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32672024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32682024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32692024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32702024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32712024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32722024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32732024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32742024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32752024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32762024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32772024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32782024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32792024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32802024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32812024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32822024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32832024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32842024-11-01T22:33:38.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 468581463 } })
32852024-11-01T22:33:38.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 468583323 } })
32862024-11-01T22:33:38.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32872024-11-01T22:33:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.204839ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32882024-11-01T22:33:38.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
32892024-11-01T22:33:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.364621ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
32902024-11-01T22:33:38.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32912024-11-01T22:33:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32922024-11-01T22:33:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32932024-11-01T22:33:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32942024-11-01T22:33:38.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32952024-11-01T22:33:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.176261ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32962024-11-01T22:33:38.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972024-11-01T22:33:38.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-11-01T22:33:38.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 473703922 } })
32992024-11-01T22:33:38.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
33002024-11-01T22:33:38.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33012024-11-01T22:33:38.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33022024-11-01T22:33:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33032024-11-01T22:33:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33042024-11-01T22:33:38.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33052024-11-01T22:33:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33062024-11-01T22:33:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33072024-11-01T22:33:38.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33082024-11-01T22:33:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33092024-11-01T22:33:38.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33102024-11-01T22:33:38.447ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33112024-11-01T22:33:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33122024-11-01T22:33:38.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33132024-11-01T22:33:38.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33142024-11-01T22:33:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33152024-11-01T22:33:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33162024-11-01T22:33:38.449ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33172024-11-01T22:33:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33182024-11-01T22:33:38.450ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:23:38.437825842 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
33192024-11-01T22:33:38.450ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.232503ms iteration = 9 status = {"expiration":"2024-11-01T22:23:38.437825842Z","pruned":[]}
33202024-11-01T22:33:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33212024-11-01T22:33:38.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33222024-11-01T22:33:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33232024-11-01T22:33:38.451ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33242024-11-01T22:33:38.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33252024-11-01T22:33:38.453ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33262024-11-01T22:33:38.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33272024-11-01T22:33:38.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33282024-11-01T22:33:38.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33292024-11-01T22:33:38.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33302024-11-01T22:33:38.458ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.525847ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
33312024-11-01T22:33:38.458ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 488809426 } })
33322024-11-01T22:33:38.459ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
33332024-11-01T22:33:38.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33342024-11-01T22:33:38.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33352024-11-01T22:33:38.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33362024-11-01T22:33:38.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33372024-11-01T22:33:38.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33382024-11-01T22:33:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33392024-11-01T22:33:38.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33402024-11-01T22:33:38.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33412024-11-01T22:33:38.464ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 494536510 } })
33422024-11-01T22:33:38.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33432024-11-01T22:33:38.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33442024-11-01T22:33:38.464ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
33452024-11-01T22:33:38.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33462024-11-01T22:33:38.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33472024-11-01T22:33:38.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33482024-11-01T22:33:38.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33492024-11-01T22:33:38.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33502024-11-01T22:33:38.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33512024-11-01T22:33:38.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33522024-11-01T22:33:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33532024-11-01T22:33:38.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33542024-11-01T22:33:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33552024-11-01T22:33:38.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33562024-11-01T22:33:38.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33572024-11-01T22:33:38.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33582024-11-01T22:33:38.488ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33592024-11-01T22:33:38.488ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33602024-11-01T22:33:38.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33612024-11-01T22:33:38.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33622024-11-01T22:33:38.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33632024-11-01T22:33:38.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33642024-11-01T22:33:38.497ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33652024-11-01T22:33:38.497ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33662024-11-01T22:33:38.497ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.750554ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33672024-11-01T22:33:38.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33682024-11-01T22:33:38.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33692024-11-01T22:33:38.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33702024-11-01T22:33:38.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.943238ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33712024-11-01T22:33:38.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33722024-11-01T22:33:38.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33732024-11-01T22:33:38.503ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33742024-11-01T22:33:38.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.195753ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33752024-11-01T22:33:38.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33762024-11-01T22:33:38.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33772024-11-01T22:33:38.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
33782024-11-01T22:33:38.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33792024-11-01T22:33:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33802024-11-01T22:33:38.517ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33812024-11-01T22:33:38.517ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33822024-11-01T22:33:38.517ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.733036ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33832024-11-01T22:33:38.524ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33842024-11-01T22:33:38.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33852024-11-01T22:33:38.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33862024-11-01T22:33:38.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33872024-11-01T22:33:38.550ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33882024-11-01T22:33:38.550ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33892024-11-01T22:33:38.550ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33902024-11-01T22:33:38.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33912024-11-01T22:33:38.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33922024-11-01T22:33:38.552ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33932024-11-01T22:33:38.552ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33942024-11-01T22:33:38.552ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33952024-11-01T22:33:38.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33962024-11-01T22:33:38.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33972024-11-01T22:33:38.562ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33982024-11-01T22:33:38.587ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33992024-11-01T22:33:38.600ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
34002024-11-01T22:33:38.600ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34012024-11-01T22:33:38.600ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a07f909-2dc6-4168-bf6e-65f9644d18df", "content-length": "26", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
34022024-11-01T22:33:38.600ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34032024-11-01T22:33:38.603ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34042024-11-01T22:33:38.611ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.016042ms iteration = 20 status = {"physical_disks_added":0}
34052024-11-01T22:33:38.632ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
34062024-11-01T22:33:38.633ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34072024-11-01T22:33:38.633ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d04e23c2-ce81-4822-8a2d-4322a3dae52e", "content-length": "26", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
34082024-11-01T22:33:38.633ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34092024-11-01T22:33:38.633ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
34102024-11-01T22:33:38.633ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34112024-11-01T22:33:38.634ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "963029c3-d9b3-4571-91fb-1bc4f186f357", "content-length": "26", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
34122024-11-01T22:33:38.634ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34132024-11-01T22:33:38.635ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
34142024-11-01T22:33:38.635ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34152024-11-01T22:33:38.653ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34162024-11-01T22:33:38.653ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34172024-11-01T22:33:38.653ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f348f853-2701-42a8-8f0c-8c8a0c2e12e2", "content-length": "372", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
34182024-11-01T22:33:38.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34192024-11-01T22:33:38.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34202024-11-01T22:33:38.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34212024-11-01T22:33:38.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34222024-11-01T22:33:38.669ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
34232024-11-01T22:33:38.669ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 231.524548ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
34242024-11-01T22:33:38.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 253.534186ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34252024-11-01T22:33:38.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262024-11-01T22:33:38.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34272024-11-01T22:33:38.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282024-11-01T22:33:38.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34292024-11-01T22:33:38.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34302024-11-01T22:33:38.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34312024-11-01T22:33:38.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34322024-11-01T22:33:38.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332024-11-01T22:33:38.702ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34342024-11-01T22:33:38.702ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34352024-11-01T22:33:38.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34362024-11-01T22:33:38.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34372024-11-01T22:33:38.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
34382024-11-01T22:33:38.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34392024-11-01T22:33:38.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34402024-11-01T22:33:38.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34412024-11-01T22:33:38.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34422024-11-01T22:33:38.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34432024-11-01T22:33:38.706ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 269.152865ms iteration = 17 status = 0
34442024-11-01T22:33:38.708ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34452024-11-01T22:33:38.708ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
34462024-11-01T22:33:38.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34472024-11-01T22:33:38.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34482024-11-01T22:33:38.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34492024-11-01T22:33:38.729ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34502024-11-01T22:33:38.729ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34512024-11-01T22:33:38.730ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f45b7a82-65e8-4f80-b4dd-3fffe0a956c3", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
34522024-11-01T22:33:38.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34532024-11-01T22:33:38.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34542024-11-01T22:33:38.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34552024-11-01T22:33:38.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34562024-11-01T22:33:38.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34572024-11-01T22:33:38.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34582024-11-01T22:33:38.741ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34592024-11-01T22:33:38.741ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34602024-11-01T22:33:38.742ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79b1acd9-5ff0-4d15-9a1d-d81f5d04ad90", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
34612024-11-01T22:33:38.743ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 306.298257ms iteration = 18 status = {}
34622024-11-01T22:33:38.754ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34632024-11-01T22:33:38.754ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34642024-11-01T22:33:38.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34652024-11-01T22:33:38.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34662024-11-01T22:33:38.757ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34672024-11-01T22:33:38.757ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34682024-11-01T22:33:38.757ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 320.186592ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34692024-11-01T22:33:38.758ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-11-01T22:33:38.761ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34712024-11-01T22:33:38.761ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34722024-11-01T22:33:38.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34732024-11-01T22:33:38.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742024-11-01T22:33:38.769ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34752024-11-01T22:33:38.769ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "079a5cc1-6868-4977-8920-d7d02e4dbc4c", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34762024-11-01T22:33:38.769ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34772024-11-01T22:33:38.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34782024-11-01T22:33:38.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34792024-11-01T22:33:38.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34802024-11-01T22:33:38.771ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "de732c8e-3338-438f-8b5c-3d72b781acaf", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34812024-11-01T22:33:38.771ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34822024-11-01T22:33:38.775ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
34832024-11-01T22:33:38.775ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34842024-11-01T22:33:38.775ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
34852024-11-01T22:33:38.775ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 337.452623ms iteration = 10 status = {"generation":2}
34862024-11-01T22:33:38.776ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34872024-11-01T22:33:38.776ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 339.039385ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34882024-11-01T22:33:38.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34892024-11-01T22:33:38.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34902024-11-01T22:33:38.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34912024-11-01T22:33:38.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34922024-11-01T22:33:38.806ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34932024-11-01T22:33:38.806ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 368.558629ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34942024-11-01T22:33:38.806ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 368.65253ms iteration = 17 status = {}
34952024-11-01T22:33:38.813ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34962024-11-01T22:33:38.813ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34972024-11-01T22:33:38.813ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
34982024-11-01T22:33:38.813ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 375.910695ms iteration = 10 status = {"generation":1}
34992024-11-01T22:33:38.815ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
35002024-11-01T22:33:38.815ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 377.709038ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35012024-11-01T22:33:38.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35022024-11-01T22:33:38.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35032024-11-01T22:33:38.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35042024-11-01T22:33:38.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35052024-11-01T22:33:38.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35062024-11-01T22:33:38.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35072024-11-01T22:33:38.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35082024-11-01T22:33:38.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35092024-11-01T22:33:38.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35102024-11-01T22:33:38.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35112024-11-01T22:33:38.858ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35122024-11-01T22:33:38.861ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6dae3cb2-3507-4686-9f03-bbab2bf07522", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
35132024-11-01T22:33:38.861ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
35142024-11-01T22:33:38.863ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5e5047a5-f4cc-451a-8452-627ee8ff536a", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
35152024-11-01T22:33:38.863ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
35162024-11-01T22:33:38.865ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eb7da8b8-6642-4aff-a91d-a85ef0b7734e", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
35172024-11-01T22:33:38.865ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
35182024-11-01T22:33:38.865ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35192024-11-01T22:33:38.866ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc75ad35-0d9d-4b71-8092-9ea3b95df0ac", "content-length": "1", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
35202024-11-01T22:33:38.866ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
35212024-11-01T22:33:38.867ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 429.13878ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35222024-11-01T22:33:38.867ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35232024-11-01T22:33:38.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35242024-11-01T22:33:38.869ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 432.111192ms iteration = 17 status = null
35252024-11-01T22:33:38.966ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35262024-11-01T22:33:38.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46d439ea-6d24-48f7-9f73-56f27f92527f", "content-length": "691", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
35272024-11-01T22:33:38.967ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35282024-11-01T22:33:38.967ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35292024-11-01T22:33:38.967ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35302024-11-01T22:33:38.968ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.746261ms iteration = 17 status = {}
35312024-11-01T22:33:38.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35322024-11-01T22:33:38.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35332024-11-01T22:33:38.973ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
35342024-11-01T22:33:38.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35352024-11-01T22:33:38.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35362024-11-01T22:33:38.984ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35372024-11-01T22:33:38.984ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ec2fe26-de8c-484b-bc24-7607a92fa37c", "content-length": "134", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
35382024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35392024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
35402024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35412024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35422024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35432024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35442024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35452024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35462024-11-01T22:33:38.984ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35472024-11-01T22:33:38.985ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35482024-11-01T22:33:38.985ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
35492024-11-01T22:33:38.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35502024-11-01T22:33:38.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35512024-11-01T22:33:38.987ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35522024-11-01T22:33:38.987ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b19e8a1-172b-4b21-bfad-c3cd97b218fd", "content-length": "2", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
35532024-11-01T22:33:38.987ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35542024-11-01T22:33:38.987ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bf68803-caed-49ac-9a08-5de9e130f037", "content-length": "52", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
35552024-11-01T22:33:38.987ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
35562024-11-01T22:33:38.987ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35572024-11-01T22:33:39.105ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9bebce5d-1d57-4265-aebe-b85457f7854c", "date": "Fri, 01 Nov 2024 22:33:38 GMT"} })
35582024-11-01T22:33:39.105ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
35592024-11-01T22:33:39.105ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35602024-11-01T22:33:39.110ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa30a34a-2bf9-4bc4-a059-21100fc2bc29", "content-length": "682", "date": "Fri, 01 Nov 2024 22:33:39 GMT"} })
35612024-11-01T22:33:39.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35622024-11-01T22:33:39.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35632024-11-01T22:33:39.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35642024-11-01T22:33:39.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35652024-11-01T22:33:39.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35662024-11-01T22:33:39.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35672024-11-01T22:33:39.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35682024-11-01T22:33:39.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35692024-11-01T22:33:39.128ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 690.323483ms iteration = 17 status = {}
35702024-11-01T22:33:39.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bec43463-da77-456b-8b84-bd7bfd2e12cc roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35712024-11-01T22:33:39.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bec43463-da77-456b-8b84-bd7bfd2e12cc resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35722024-11-01T22:33:39.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bec43463-da77-456b-8b84-bd7bfd2e12cc response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35732024-11-01T22:33:39.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 89c22324-d075-41dc-a8a5-2016e976e1fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
35742024-11-01T22:33:39.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 89c22324-d075-41dc-a8a5-2016e976e1fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
35752024-11-01T22:33:39.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 89c22324-d075-41dc-a8a5-2016e976e1fa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
35762024-11-01T22:33:40.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1947cdb1-6608-40b9-84c6-319b288e1966 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35772024-11-01T22:33:40.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1947cdb1-6608-40b9-84c6-319b288e1966 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35782024-11-01T22:33:40.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1947cdb1-6608-40b9-84c6-319b288e1966 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35792024-11-01T22:33:40.690ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
35802024-11-01T22:33:40.690ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
35812024-11-01T22:33:40.719ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
35822024-11-01T22:33:40.719ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:46115
35832024-11-01T22:33:40.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46115 req_id = 84caaf3c-0f94-4564-acb4-2d8888061375 roles = RoleSet { roles: {} } uri = /metrics/producers
35842024-11-01T22:33:40.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46115 req_id = 84caaf3c-0f94-4564-acb4-2d8888061375 resource = Database result = Ok(()) uri = /metrics/producers
35852024-11-01T22:33:40.758ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
35862024-11-01T22:33:40.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38397 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46115 req_id = 84caaf3c-0f94-4564-acb4-2d8888061375 response_code = 201 uri = /metrics/producers
35872024-11-01T22:33:40.758ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "84caaf3c-0f94-4564-acb4-2d8888061375", "content-length": "41", "date": "Fri, 01 Nov 2024 22:33:40 GMT"} })
35882024-11-01T22:33:40.760ZDEBGnexus (producer-registration-task): registered with nexus successfully
35892024-11-01T22:33:40.760ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
35902024-11-01T22:33:41.072ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61726
35912024-11-01T22:33:41.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61726 req_id = affe7e0e-3129-42bf-b354-5f0443bc69e7 roles = RoleSet { roles: {} } uri = /metrics/producers
35922024-11-01T22:33:41.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61726 req_id = affe7e0e-3129-42bf-b354-5f0443bc69e7 resource = Database result = Ok(()) uri = /metrics/producers
35932024-11-01T22:33:41.117ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = f3786bce-13d3-45c6-95c4-d92d9e1f531e
35942024-11-01T22:33:41.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44810 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61726 req_id = affe7e0e-3129-42bf-b354-5f0443bc69e7 response_code = 201 uri = /metrics/producers
35952024-11-01T22:33:41.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 509529ef-7910-4fb1-b4aa-b314d66c5d17 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35962024-11-01T22:33:41.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 509529ef-7910-4fb1-b4aa-b314d66c5d17 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35972024-11-01T22:33:41.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 509529ef-7910-4fb1-b4aa-b314d66c5d17 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35982024-11-01T22:33:42.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c67e4c7-8e0c-4cbf-b41d-7a54d4e88dbc roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
35992024-11-01T22:33:42.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c67e4c7-8e0c-4cbf-b41d-7a54d4e88dbc resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36002024-11-01T22:33:42.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c67e4c7-8e0c-4cbf-b41d-7a54d4e88dbc response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36012024-11-01T22:33:42.655ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48495
36022024-11-01T22:33:42.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48495 req_id = 96facf46-99d6-4a27-901a-c0f4cfa1e886 roles = RoleSet { roles: {} } uri = /metrics/producers
36032024-11-01T22:33:42.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48495 req_id = 96facf46-99d6-4a27-901a-c0f4cfa1e886 resource = Database result = Ok(()) uri = /metrics/producers
36042024-11-01T22:33:42.693ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 6a9b750b-1518-4ee5-bf47-863dffe85843
36052024-11-01T22:33:42.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38269 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48495 req_id = 96facf46-99d6-4a27-901a-c0f4cfa1e886 response_code = 201 uri = /metrics/producers
36062024-11-01T22:33:43.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1482 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = ff30d75c-1cba-4a45-ab79-c9ad24b394e6 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
36072024-11-01T22:33:43.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f2ac70e-485e-4776-a7e8-c0b9151ea419 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36082024-11-01T22:33:43.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f2ac70e-485e-4776-a7e8-c0b9151ea419 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36092024-11-01T22:33:43.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f2ac70e-485e-4776-a7e8-c0b9151ea419 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36102024-11-01T22:33:44.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dad92395-3fa5-4cfb-bc88-023dfc30af56 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36112024-11-01T22:33:44.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dad92395-3fa5-4cfb-bc88-023dfc30af56 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36122024-11-01T22:33:44.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dad92395-3fa5-4cfb-bc88-023dfc30af56 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36132024-11-01T22:33:45.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e6bd7be-4826-4708-8c0c-7018141b5469 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36142024-11-01T22:33:45.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e6bd7be-4826-4708-8c0c-7018141b5469 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36152024-11-01T22:33:45.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e6bd7be-4826-4708-8c0c-7018141b5469 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36162024-11-01T22:33:45.571ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52352
36172024-11-01T22:33:45.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52352 req_id = 949138f9-e9f0-426c-ad7e-ea2254d9f171 roles = RoleSet { roles: {} } uri = /metrics/producers
36182024-11-01T22:33:45.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52352 req_id = 949138f9-e9f0-426c-ad7e-ea2254d9f171 resource = Database result = Ok(()) uri = /metrics/producers
36192024-11-01T22:33:45.607ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 66c10e19-a80d-4554-a39b-bc1969f7015e
36202024-11-01T22:33:45.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35886 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52352 req_id = 949138f9-e9f0-426c-ad7e-ea2254d9f171 response_code = 201 uri = /metrics/producers
36212024-11-01T22:33:46.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7822db48-fb51-4cda-a0a2-37cdf3aa99a9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36222024-11-01T22:33:46.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7822db48-fb51-4cda-a0a2-37cdf3aa99a9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36232024-11-01T22:33:46.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7822db48-fb51-4cda-a0a2-37cdf3aa99a9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36242024-11-01T22:33:47.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b65d9fe4-a743-49f9-a17d-41c3174faafb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36252024-11-01T22:33:47.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b65d9fe4-a743-49f9-a17d-41c3174faafb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36262024-11-01T22:33:47.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b65d9fe4-a743-49f9-a17d-41c3174faafb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36272024-11-01T22:33:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
36282024-11-01T22:33:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
36292024-11-01T22:33:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36302024-11-01T22:33:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36312024-11-01T22:33:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36322024-11-01T22:33:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36332024-11-01T22:33:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36342024-11-01T22:33:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36352024-11-01T22:33:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36362024-11-01T22:33:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36372024-11-01T22:33:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36382024-11-01T22:33:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36392024-11-01T22:33:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36402024-11-01T22:33:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
36412024-11-01T22:33:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36422024-11-01T22:33:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36432024-11-01T22:33:48.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
36442024-11-01T22:33:48.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.556391ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
36452024-11-01T22:33:48.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36462024-11-01T22:33:48.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36472024-11-01T22:33:48.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.812594ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36482024-11-01T22:33:48.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 90efbffd-11ac-40b8-967e-f341a0bfaf5f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36492024-11-01T22:33:48.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 90efbffd-11ac-40b8-967e-f341a0bfaf5f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36502024-11-01T22:33:48.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 90efbffd-11ac-40b8-967e-f341a0bfaf5f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36512024-11-01T22:33:49.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96d5d022-6359-4910-9072-aea2aabbd313 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36522024-11-01T22:33:49.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96d5d022-6359-4910-9072-aea2aabbd313 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36532024-11-01T22:33:49.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96d5d022-6359-4910-9072-aea2aabbd313 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36542024-11-01T22:33:49.828ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44838
36552024-11-01T22:33:49.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44838 req_id = f04526a0-c557-466c-9cf4-403a9b0717cc roles = RoleSet { roles: {} } uri = /metrics/producers
36562024-11-01T22:33:49.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44838 req_id = f04526a0-c557-466c-9cf4-403a9b0717cc resource = Database result = Ok(()) uri = /metrics/producers
36572024-11-01T22:33:49.840ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
36582024-11-01T22:33:49.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12650 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44838 req_id = f04526a0-c557-466c-9cf4-403a9b0717cc response_code = 201 uri = /metrics/producers
36592024-11-01T22:33:50.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2df36517-bf55-49c6-a806-262968b7fa27 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36602024-11-01T22:33:50.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2df36517-bf55-49c6-a806-262968b7fa27 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36612024-11-01T22:33:50.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2df36517-bf55-49c6-a806-262968b7fa27 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36622024-11-01T22:33:51.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20f25e72-3a14-4769-a1c1-7c102c6e260f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36632024-11-01T22:33:51.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20f25e72-3a14-4769-a1c1-7c102c6e260f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36642024-11-01T22:33:51.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20f25e72-3a14-4769-a1c1-7c102c6e260f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36652024-11-01T22:33:52.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5d6091aa-eadc-4dbb-a176-59421b7cb284 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36662024-11-01T22:33:52.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5d6091aa-eadc-4dbb-a176-59421b7cb284 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36672024-11-01T22:33:52.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5d6091aa-eadc-4dbb-a176-59421b7cb284 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36682024-11-01T22:33:53.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c6442d91-5732-4c4b-8cb7-a02403c870f2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36692024-11-01T22:33:53.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c6442d91-5732-4c4b-8cb7-a02403c870f2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36702024-11-01T22:33:53.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c6442d91-5732-4c4b-8cb7-a02403c870f2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36712024-11-01T22:33:54.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5db2fe3-d9c2-43cf-a079-ed0b805905a6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36722024-11-01T22:33:54.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5db2fe3-d9c2-43cf-a079-ed0b805905a6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36732024-11-01T22:33:54.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5db2fe3-d9c2-43cf-a079-ed0b805905a6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36742024-11-01T22:33:55.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a9280dd8-06f5-4084-82d3-64c67da4c519 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36752024-11-01T22:33:55.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a9280dd8-06f5-4084-82d3-64c67da4c519 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36762024-11-01T22:33:55.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a9280dd8-06f5-4084-82d3-64c67da4c519 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36772024-11-01T22:33:56.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ca02d31-cb8a-4639-bafc-68d1ca579de0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36782024-11-01T22:33:56.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ca02d31-cb8a-4639-bafc-68d1ca579de0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36792024-11-01T22:33:56.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ca02d31-cb8a-4639-bafc-68d1ca579de0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36802024-11-01T22:33:57.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 434a5ba2-cebb-4d64-9196-80c7c6fab59a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36812024-11-01T22:33:57.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 434a5ba2-cebb-4d64-9196-80c7c6fab59a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36822024-11-01T22:33:57.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 434a5ba2-cebb-4d64-9196-80c7c6fab59a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
36832024-11-01T22:33:58.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1360 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 97d023f1-b60c-4247-900f-77ee974933a8 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
36842024-11-01T22:33:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
36852024-11-01T22:33:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36862024-11-01T22:33:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
36872024-11-01T22:33:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36882024-11-01T22:33:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36892024-11-01T22:33:58.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36902024-11-01T22:33:58.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36912024-11-01T22:33:58.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36922024-11-01T22:33:58.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36932024-11-01T22:33:58.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36942024-11-01T22:33:58.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36952024-11-01T22:33:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36962024-11-01T22:33:58.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972024-11-01T22:33:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
36982024-11-01T22:33:58.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36992024-11-01T22:33:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37002024-11-01T22:33:58.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
37012024-11-01T22:33:58.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.603702ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
37022024-11-01T22:33:58.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37032024-11-01T22:33:58.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37042024-11-01T22:33:58.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.93864ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37052024-11-01T22:33:58.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5b87d520-d701-4ee9-92c1-ac2d5072c9a1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37062024-11-01T22:33:58.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5b87d520-d701-4ee9-92c1-ac2d5072c9a1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37072024-11-01T22:33:58.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5b87d520-d701-4ee9-92c1-ac2d5072c9a1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37082024-11-01T22:33:59.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c67b45d9-762b-47eb-93af-a70b9ff49cf9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37092024-11-01T22:33:59.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c67b45d9-762b-47eb-93af-a70b9ff49cf9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37102024-11-01T22:33:59.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c67b45d9-762b-47eb-93af-a70b9ff49cf9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37112024-11-01T22:34:00.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c99151c-6add-4410-9309-f885b104c9a5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37122024-11-01T22:34:00.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c99151c-6add-4410-9309-f885b104c9a5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37132024-11-01T22:34:00.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c99151c-6add-4410-9309-f885b104c9a5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37142024-11-01T22:34:01.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 37e34737-ffbd-436a-8f1e-629d2586b79c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37152024-11-01T22:34:01.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 37e34737-ffbd-436a-8f1e-629d2586b79c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37162024-11-01T22:34:01.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 37e34737-ffbd-436a-8f1e-629d2586b79c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37172024-11-01T22:34:02.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a500e3e5-d813-4282-a66d-b1a5a593ce8b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37182024-11-01T22:34:02.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a500e3e5-d813-4282-a66d-b1a5a593ce8b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37192024-11-01T22:34:02.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a500e3e5-d813-4282-a66d-b1a5a593ce8b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37202024-11-01T22:34:03.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 601d05bf-95f9-474a-8a4b-1f0500ae512d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37212024-11-01T22:34:03.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 601d05bf-95f9-474a-8a4b-1f0500ae512d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37222024-11-01T22:34:03.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 601d05bf-95f9-474a-8a4b-1f0500ae512d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37232024-11-01T22:34:04.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e604f1e8-f0c8-4817-a5f9-e6b982b421ce roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37242024-11-01T22:34:04.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e604f1e8-f0c8-4817-a5f9-e6b982b421ce resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37252024-11-01T22:34:04.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e604f1e8-f0c8-4817-a5f9-e6b982b421ce response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37262024-11-01T22:34:05.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68a98934-b372-4ade-b532-14124a74a7be roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37272024-11-01T22:34:05.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68a98934-b372-4ade-b532-14124a74a7be resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37282024-11-01T22:34:05.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68a98934-b372-4ade-b532-14124a74a7be response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37292024-11-01T22:34:06.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 78dbb4bd-437e-48bb-999c-864753de249c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37302024-11-01T22:34:06.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 78dbb4bd-437e-48bb-999c-864753de249c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37312024-11-01T22:34:06.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 78dbb4bd-437e-48bb-999c-864753de249c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37322024-11-01T22:34:07.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8418b6ce-0fcd-4a4d-afd3-6b9fa15cd882 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37332024-11-01T22:34:07.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8418b6ce-0fcd-4a4d-afd3-6b9fa15cd882 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37342024-11-01T22:34:07.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8418b6ce-0fcd-4a4d-afd3-6b9fa15cd882 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
37352024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
37362024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 18.37\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37372024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
37382024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37392024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
37402024-11-01T22:34:08.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37412024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37422024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
37432024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37442024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37452024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
37462024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
37472024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37482024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37492024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
37502024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
37512024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37522024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37532024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
37542024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37552024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
37562024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37572024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
37582024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37592024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
37602024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
37612024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.69\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
37622024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
37632024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.8\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37642024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37652024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
37662024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
37672024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37682024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
37692024-11-01T22:34:08.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.69\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
37702024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37712024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37722024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37732024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37742024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37752024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37762024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37772024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37782024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37792024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37802024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37812024-11-01T22:34:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37822024-11-01T22:34:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37832024-11-01T22:34:08.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.313215ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37842024-11-01T22:34:08.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37852024-11-01T22:34:08.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37862024-11-01T22:34:08.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37872024-11-01T22:34:08.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37882024-11-01T22:34:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37892024-11-01T22:34:08.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37902024-11-01T22:34:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37912024-11-01T22:34:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37922024-11-01T22:34:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37932024-11-01T22:34:08.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37942024-11-01T22:34:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37952024-11-01T22:34:08.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37962024-11-01T22:34:08.447ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 477480640 } })
37972024-11-01T22:34:08.447ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 477690332 } })
37982024-11-01T22:34:08.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
37992024-11-01T22:34:08.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
38002024-11-01T22:34:08.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38012024-11-01T22:34:08.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38022024-11-01T22:34:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38032024-11-01T22:34:08.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-11-01T22:34:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-11-01T22:34:08.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38062024-11-01T22:34:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38072024-11-01T22:34:08.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38082024-11-01T22:34:08.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
38092024-11-01T22:34:08.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38102024-11-01T22:34:08.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38112024-11-01T22:34:08.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
38122024-11-01T22:34:08.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.710675ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
38132024-11-01T22:34:08.468ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38142024-11-01T22:34:08.468ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38152024-11-01T22:34:08.468ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38162024-11-01T22:34:08.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38172024-11-01T22:34:08.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38182024-11-01T22:34:08.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38192024-11-01T22:34:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38202024-11-01T22:34:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38212024-11-01T22:34:08.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38222024-11-01T22:34:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38232024-11-01T22:34:08.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38242024-11-01T22:34:08.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38252024-11-01T22:34:08.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38262024-11-01T22:34:08.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38272024-11-01T22:34:08.477ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38282024-11-01T22:34:08.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38292024-11-01T22:34:08.480ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 510099178 } })
38302024-11-01T22:34:08.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38312024-11-01T22:34:08.480ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
38322024-11-01T22:34:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38332024-11-01T22:34:08.481ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38342024-11-01T22:34:08.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38352024-11-01T22:34:08.482ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38362024-11-01T22:34:08.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.402767ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38372024-11-01T22:34:08.483ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38382024-11-01T22:34:08.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38392024-11-01T22:34:08.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38402024-11-01T22:34:08.484ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38412024-11-01T22:34:08.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38422024-11-01T22:34:08.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38432024-11-01T22:34:08.485ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38442024-11-01T22:34:08.485ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.372372ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38452024-11-01T22:34:08.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38462024-11-01T22:34:08.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38472024-11-01T22:34:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38482024-11-01T22:34:08.508ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38492024-11-01T22:34:08.508ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38502024-11-01T22:34:08.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38512024-11-01T22:34:08.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38522024-11-01T22:34:08.510ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38532024-11-01T22:34:08.510ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38542024-11-01T22:34:08.510ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 72.027238ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38552024-11-01T22:34:08.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38562024-11-01T22:34:08.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
38572024-11-01T22:34:08.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38582024-11-01T22:34:08.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38592024-11-01T22:34:08.518ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
38602024-11-01T22:34:08.518ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38612024-11-01T22:34:08.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.542864ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38622024-11-01T22:34:08.518ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d07886ae-fa85-4b7e-8b96-0c790b4db370", "content-length": "26", "date": "Fri, 01 Nov 2024 22:34:07 GMT"} })
38632024-11-01T22:34:08.518ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38642024-11-01T22:34:08.519ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.29222ms iteration = 18 status = 0
38652024-11-01T22:34:08.520ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38662024-11-01T22:34:08.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
38672024-11-01T22:34:08.528ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38682024-11-01T22:34:08.529ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2460c04d-ca6c-471f-801c-d45dc3ae46df", "content-length": "26", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
38692024-11-01T22:34:08.529ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38702024-11-01T22:34:08.530ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38712024-11-01T22:34:08.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38722024-11-01T22:34:08.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38732024-11-01T22:34:08.568ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
38742024-11-01T22:34:08.568ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38752024-11-01T22:34:08.568ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "026c9a58-0147-47b9-8358-4e348f0892b7", "content-length": "26", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
38762024-11-01T22:34:08.568ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38772024-11-01T22:34:08.570ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
38782024-11-01T22:34:08.600ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.574837ms iteration = 21 status = {"physical_disks_added":0}
38792024-11-01T22:34:08.608ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 170.068452ms iteration = 18 status = {}
38802024-11-01T22:34:08.638ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38812024-11-01T22:34:08.638ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "33d408a9-79d2-495e-b2ad-e1eee174e2d2", "content-length": "1", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
38822024-11-01T22:34:08.639ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38832024-11-01T22:34:08.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38842024-11-01T22:34:08.641ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.033733ms iteration = 18 status = null
38852024-11-01T22:34:08.647ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38862024-11-01T22:34:08.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38872024-11-01T22:34:08.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d7b0269-92c1-4cee-b6e4-f4ee4ea26bd2", "content-length": "372", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
38882024-11-01T22:34:08.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38892024-11-01T22:34:08.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38902024-11-01T22:34:08.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38912024-11-01T22:34:08.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38922024-11-01T22:34:08.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38932024-11-01T22:34:08.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38942024-11-01T22:34:08.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38952024-11-01T22:34:08.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38962024-11-01T22:34:08.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38972024-11-01T22:34:08.671ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38982024-11-01T22:34:08.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38992024-11-01T22:34:08.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39002024-11-01T22:34:08.702ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
39012024-11-01T22:34:08.702ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39022024-11-01T22:34:08.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4f3836f4-6e7f-4ba0-973f-ff2184c98d50", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39032024-11-01T22:34:08.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39042024-11-01T22:34:08.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39052024-11-01T22:34:08.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39062024-11-01T22:34:08.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39072024-11-01T22:34:08.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39082024-11-01T22:34:08.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39092024-11-01T22:34:08.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39102024-11-01T22:34:08.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39112024-11-01T22:34:08.721ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
39122024-11-01T22:34:08.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39132024-11-01T22:34:08.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39142024-11-01T22:34:08.726ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39152024-11-01T22:34:08.726ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39162024-11-01T22:34:08.726ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bb760610-5bb1-4b70-80e3-ca809238d7a4", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39172024-11-01T22:34:08.728ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.223294ms iteration = 19 status = {}
39182024-11-01T22:34:08.732ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39192024-11-01T22:34:08.732ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ab948a1-837b-47e7-bb6d-bbb43fad1d00", "content-length": "134", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39202024-11-01T22:34:08.732ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39212024-11-01T22:34:08.732ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
39222024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39232024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39242024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39252024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39262024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39272024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39282024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39292024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39302024-11-01T22:34:08.733ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
39312024-11-01T22:34:08.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39322024-11-01T22:34:08.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39332024-11-01T22:34:08.735ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39342024-11-01T22:34:08.735ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a40c50c6-d9f0-497f-ac26-c77d6893a42d", "content-length": "2", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39352024-11-01T22:34:08.735ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39362024-11-01T22:34:08.735ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "858d2d84-8378-46bd-8d14-e650b97b6d2e", "content-length": "52", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39372024-11-01T22:34:08.735ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
39382024-11-01T22:34:08.735ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39392024-11-01T22:34:08.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39402024-11-01T22:34:08.850ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a347843b-3616-4079-b0b4-25e53c39ee59", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39412024-11-01T22:34:08.850ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
39422024-11-01T22:34:08.850ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39432024-11-01T22:34:08.850ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "86a36a1c-99b4-4f44-8114-683b03ef7833", "content-length": "682", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39442024-11-01T22:34:08.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39452024-11-01T22:34:08.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39462024-11-01T22:34:08.851ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5e491f9-8ada-4b3a-a4a6-47e6918334f6", "content-length": "691", "date": "Fri, 01 Nov 2024 22:34:08 GMT"} })
39472024-11-01T22:34:08.851ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
39482024-11-01T22:34:08.851ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
39492024-11-01T22:34:08.851ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
39502024-11-01T22:34:08.853ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.277387ms iteration = 18 status = {}
39512024-11-01T22:34:08.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39522024-11-01T22:34:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39532024-11-01T22:34:08.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39542024-11-01T22:34:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39552024-11-01T22:34:08.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39562024-11-01T22:34:08.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39572024-11-01T22:34:08.869ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 430.825163ms iteration = 18 status = {}
39582024-11-01T22:34:08.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ec243dd6-9121-4fe3-9ca1-4165a7772ab6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39592024-11-01T22:34:08.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ec243dd6-9121-4fe3-9ca1-4165a7772ab6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39602024-11-01T22:34:08.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ec243dd6-9121-4fe3-9ca1-4165a7772ab6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39612024-11-01T22:34:09.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 12e234c5-4fd5-4ef9-bbef-9047b851f093 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
39622024-11-01T22:34:09.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 12e234c5-4fd5-4ef9-bbef-9047b851f093 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
39632024-11-01T22:34:09.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 12e234c5-4fd5-4ef9-bbef-9047b851f093 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
39642024-11-01T22:34:10.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 699632ce-eef6-4e81-a931-645f2237c229 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39652024-11-01T22:34:10.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 699632ce-eef6-4e81-a931-645f2237c229 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39662024-11-01T22:34:10.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 699632ce-eef6-4e81-a931-645f2237c229 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39672024-11-01T22:34:11.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9dc8f054-26e5-4a48-bb7d-cc2b9caa93a4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39682024-11-01T22:34:11.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9dc8f054-26e5-4a48-bb7d-cc2b9caa93a4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39692024-11-01T22:34:11.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9dc8f054-26e5-4a48-bb7d-cc2b9caa93a4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39702024-11-01T22:34:12.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bdef7333-7801-4eda-9aa0-fc1337295709 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39712024-11-01T22:34:12.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bdef7333-7801-4eda-9aa0-fc1337295709 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39722024-11-01T22:34:12.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bdef7333-7801-4eda-9aa0-fc1337295709 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39732024-11-01T22:34:13.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 42b57422-9761-43a1-8d63-c6bc38c57173 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39742024-11-01T22:34:13.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 42b57422-9761-43a1-8d63-c6bc38c57173 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39752024-11-01T22:34:13.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 42b57422-9761-43a1-8d63-c6bc38c57173 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39762024-11-01T22:34:13.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1557 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 86d11b45-7f72-43bf-a617-23f56a79c66c response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
39772024-11-01T22:34:14.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3f2f139f-fe8f-4a9d-b570-d4c82bdb8d91 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39782024-11-01T22:34:14.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3f2f139f-fe8f-4a9d-b570-d4c82bdb8d91 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39792024-11-01T22:34:14.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3f2f139f-fe8f-4a9d-b570-d4c82bdb8d91 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39802024-11-01T22:34:15.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8fd94f84-bc3b-4883-9f4a-626fae591dab roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39812024-11-01T22:34:15.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8fd94f84-bc3b-4883-9f4a-626fae591dab resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39822024-11-01T22:34:15.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8fd94f84-bc3b-4883-9f4a-626fae591dab response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39832024-11-01T22:34:16.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e5c8ae5-67b2-4f9d-8ae9-5ee69de67fa2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39842024-11-01T22:34:16.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e5c8ae5-67b2-4f9d-8ae9-5ee69de67fa2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39852024-11-01T22:34:16.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e5c8ae5-67b2-4f9d-8ae9-5ee69de67fa2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39862024-11-01T22:34:17.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 454e8352-d8ea-4853-8c0f-39aba71efb2a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39872024-11-01T22:34:17.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 454e8352-d8ea-4853-8c0f-39aba71efb2a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39882024-11-01T22:34:17.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 454e8352-d8ea-4853-8c0f-39aba71efb2a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39892024-11-01T22:34:18.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d1ac145-cccb-4723-a01e-1fd6ae6ac24a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39902024-11-01T22:34:18.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d1ac145-cccb-4723-a01e-1fd6ae6ac24a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39912024-11-01T22:34:18.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d1ac145-cccb-4723-a01e-1fd6ae6ac24a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
39922024-11-01T22:34:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
39932024-11-01T22:34:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39942024-11-01T22:34:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
39952024-11-01T22:34:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39962024-11-01T22:34:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39972024-11-01T22:34:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39982024-11-01T22:34:18.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39992024-11-01T22:34:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40002024-11-01T22:34:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40012024-11-01T22:34:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40022024-11-01T22:34:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40032024-11-01T22:34:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40042024-11-01T22:34:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40052024-11-01T22:34:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40062024-11-01T22:34:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40072024-11-01T22:34:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
40082024-11-01T22:34:18.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40092024-11-01T22:34:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40102024-11-01T22:34:18.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
40112024-11-01T22:34:18.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.571351ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
40122024-11-01T22:34:18.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.734113ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40132024-11-01T22:34:19.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0bd8d4d8-7e30-44d4-8f73-63cf7cef778e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40142024-11-01T22:34:19.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0bd8d4d8-7e30-44d4-8f73-63cf7cef778e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40152024-11-01T22:34:19.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0bd8d4d8-7e30-44d4-8f73-63cf7cef778e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40162024-11-01T22:34:20.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d51227b6-d7c4-4b2a-a7d4-b7be5147027f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40172024-11-01T22:34:20.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d51227b6-d7c4-4b2a-a7d4-b7be5147027f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40182024-11-01T22:34:20.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d51227b6-d7c4-4b2a-a7d4-b7be5147027f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40192024-11-01T22:34:21.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e8b099a-006d-4205-a0d5-2d13de08433f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40202024-11-01T22:34:21.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e8b099a-006d-4205-a0d5-2d13de08433f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40212024-11-01T22:34:21.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e8b099a-006d-4205-a0d5-2d13de08433f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40222024-11-01T22:34:22.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba9122bf-63ae-4beb-bcdb-ca3b93f48d89 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40232024-11-01T22:34:22.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba9122bf-63ae-4beb-bcdb-ca3b93f48d89 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40242024-11-01T22:34:22.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba9122bf-63ae-4beb-bcdb-ca3b93f48d89 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40252024-11-01T22:34:23.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5509cbff-b294-467c-badd-bd30a120009d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40262024-11-01T22:34:23.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5509cbff-b294-467c-badd-bd30a120009d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40272024-11-01T22:34:23.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5509cbff-b294-467c-badd-bd30a120009d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40282024-11-01T22:34:24.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = edbd27a0-eb4d-4b1d-a029-b01843249e3a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40292024-11-01T22:34:24.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = edbd27a0-eb4d-4b1d-a029-b01843249e3a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40302024-11-01T22:34:24.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = edbd27a0-eb4d-4b1d-a029-b01843249e3a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40312024-11-01T22:34:25.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 625b52d3-d600-43ad-bcc9-57706a208a05 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40322024-11-01T22:34:25.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 625b52d3-d600-43ad-bcc9-57706a208a05 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40332024-11-01T22:34:25.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 625b52d3-d600-43ad-bcc9-57706a208a05 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40342024-11-01T22:34:26.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 62a5bba5-6509-43d1-bb62-644b8c59bc38 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40352024-11-01T22:34:26.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 62a5bba5-6509-43d1-bb62-644b8c59bc38 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40362024-11-01T22:34:26.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 62a5bba5-6509-43d1-bb62-644b8c59bc38 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40372024-11-01T22:34:27.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 862ac3a4-bb55-4544-ac9c-5b74a8f4be12 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40382024-11-01T22:34:27.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 862ac3a4-bb55-4544-ac9c-5b74a8f4be12 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40392024-11-01T22:34:27.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 862ac3a4-bb55-4544-ac9c-5b74a8f4be12 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40402024-11-01T22:34:28.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1315 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 89262d16-2768-41e8-ba19-5378a85a9408 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
40412024-11-01T22:34:28.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b7770e6-964b-4154-96e3-ac73ce5ef412 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40422024-11-01T22:34:28.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b7770e6-964b-4154-96e3-ac73ce5ef412 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40432024-11-01T22:34:28.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2b7770e6-964b-4154-96e3-ac73ce5ef412 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40442024-11-01T22:34:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
40452024-11-01T22:34:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
40462024-11-01T22:34:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40472024-11-01T22:34:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40482024-11-01T22:34:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40492024-11-01T22:34:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40502024-11-01T22:34:28.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40512024-11-01T22:34:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40522024-11-01T22:34:28.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40532024-11-01T22:34:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40542024-11-01T22:34:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40552024-11-01T22:34:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40562024-11-01T22:34:28.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40572024-11-01T22:34:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
40582024-11-01T22:34:28.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40592024-11-01T22:34:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40602024-11-01T22:34:28.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
40612024-11-01T22:34:28.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.188232ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
40622024-11-01T22:34:28.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40632024-11-01T22:34:28.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40642024-11-01T22:34:28.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.55189ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40652024-11-01T22:34:29.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5883cad2-b50f-47cc-a74e-08074f2ba6fd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40662024-11-01T22:34:29.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5883cad2-b50f-47cc-a74e-08074f2ba6fd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40672024-11-01T22:34:29.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5883cad2-b50f-47cc-a74e-08074f2ba6fd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40682024-11-01T22:34:30.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b0dc91b-31c1-400d-b9ca-319df2b850d9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40692024-11-01T22:34:30.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b0dc91b-31c1-400d-b9ca-319df2b850d9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40702024-11-01T22:34:30.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b0dc91b-31c1-400d-b9ca-319df2b850d9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40712024-11-01T22:34:31.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c8975c6-f413-401c-9dff-3cd58747d5be roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40722024-11-01T22:34:31.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c8975c6-f413-401c-9dff-3cd58747d5be resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40732024-11-01T22:34:31.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c8975c6-f413-401c-9dff-3cd58747d5be response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40742024-11-01T22:34:32.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 73b2b4be-a0a5-4a47-a04c-dd2a6f8a64f5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40752024-11-01T22:34:32.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 73b2b4be-a0a5-4a47-a04c-dd2a6f8a64f5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40762024-11-01T22:34:32.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 73b2b4be-a0a5-4a47-a04c-dd2a6f8a64f5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40772024-11-01T22:34:33.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f44b5fe-0169-4cdb-9e66-d37b7a138611 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40782024-11-01T22:34:33.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f44b5fe-0169-4cdb-9e66-d37b7a138611 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40792024-11-01T22:34:33.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f44b5fe-0169-4cdb-9e66-d37b7a138611 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40802024-11-01T22:34:34.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8e1aa67-b75b-41ff-a4ac-797cb048931c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40812024-11-01T22:34:34.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8e1aa67-b75b-41ff-a4ac-797cb048931c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40822024-11-01T22:34:34.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8e1aa67-b75b-41ff-a4ac-797cb048931c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40832024-11-01T22:34:35.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b4141799-36c9-481c-a484-bd0a22727f0c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40842024-11-01T22:34:35.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b4141799-36c9-481c-a484-bd0a22727f0c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40852024-11-01T22:34:35.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b4141799-36c9-481c-a484-bd0a22727f0c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40862024-11-01T22:34:36.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f18bac-a7ce-4d54-b9ac-424936f9b695 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40872024-11-01T22:34:36.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f18bac-a7ce-4d54-b9ac-424936f9b695 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40882024-11-01T22:34:36.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f18bac-a7ce-4d54-b9ac-424936f9b695 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40892024-11-01T22:34:37.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f68806ac-eda9-4a02-8f97-87833ee019d6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40902024-11-01T22:34:37.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f68806ac-eda9-4a02-8f97-87833ee019d6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40912024-11-01T22:34:37.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f68806ac-eda9-4a02-8f97-87833ee019d6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
40922024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
40932024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 20.3\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40942024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
40952024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
40962024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
40972024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40982024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40992024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
41002024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41012024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
41022024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
41032024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
41042024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.55\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
41052024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
41062024-11-01T22:34:38.438ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41072024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41082024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
41092024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
41102024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41112024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
41122024-11-01T22:34:38.438ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
41132024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
41142024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41152024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.46\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
41162024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41172024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
41182024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
41192024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41202024-11-01T22:34:38.438ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:24:38.438810114 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41212024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41222024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
41232024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
41242024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
41252024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41262024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41272024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
41282024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
41292024-11-01T22:34:38.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41302024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
41312024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41322024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41332024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
41342024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
41352024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41362024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41372024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
41382024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41392024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41402024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
41412024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41422024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
41432024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
41442024-11-01T22:34:38.439ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41452024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41462024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
41472024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.749\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41482024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
41492024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
41502024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.8\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
41512024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41522024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
41532024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41542024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
41552024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41562024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41572024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41582024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41592024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41602024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41612024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41622024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41632024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41642024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41652024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41662024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41672024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41682024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41692024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41702024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41712024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41722024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41732024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41742024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41752024-11-01T22:34:38.439ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 468923466 } })
41762024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41772024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41782024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41792024-11-01T22:34:38.439ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 469025996 } })
41802024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41812024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41822024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41832024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41842024-11-01T22:34:38.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41852024-11-01T22:34:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.036528ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41862024-11-01T22:34:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41872024-11-01T22:34:38.440ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41882024-11-01T22:34:38.440ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
41892024-11-01T22:34:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41902024-11-01T22:34:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.410271ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
41912024-11-01T22:34:38.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41922024-11-01T22:34:38.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41932024-11-01T22:34:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.042443ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
41942024-11-01T22:34:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41952024-11-01T22:34:38.442ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962024-11-01T22:34:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.619818ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41972024-11-01T22:34:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41982024-11-01T22:34:38.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41992024-11-01T22:34:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42002024-11-01T22:34:38.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42012024-11-01T22:34:38.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42022024-11-01T22:34:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42032024-11-01T22:34:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42042024-11-01T22:34:38.444ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42052024-11-01T22:34:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42062024-11-01T22:34:38.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 474617359 } })
42072024-11-01T22:34:38.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
42082024-11-01T22:34:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42092024-11-01T22:34:38.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42102024-11-01T22:34:38.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42112024-11-01T22:34:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42122024-11-01T22:34:38.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42132024-11-01T22:34:38.448ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:24:38.438810114 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42142024-11-01T22:34:38.448ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42152024-11-01T22:34:38.448ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.710714ms iteration = 10 status = {"expiration":"2024-11-01T22:24:38.438810114Z","pruned":[]}
42162024-11-01T22:34:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42172024-11-01T22:34:38.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42182024-11-01T22:34:38.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 479168283 } })
42192024-11-01T22:34:38.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42202024-11-01T22:34:38.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
42212024-11-01T22:34:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42222024-11-01T22:34:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42232024-11-01T22:34:38.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42242024-11-01T22:34:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42252024-11-01T22:34:38.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262024-11-01T22:34:38.454ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42272024-11-01T22:34:38.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42282024-11-01T22:34:38.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42292024-11-01T22:34:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42302024-11-01T22:34:38.457ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42312024-11-01T22:34:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42322024-11-01T22:34:38.457ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 487183144 } })
42332024-11-01T22:34:38.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
42342024-11-01T22:34:38.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42352024-11-01T22:34:38.458ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42362024-11-01T22:34:38.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42372024-11-01T22:34:38.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42382024-11-01T22:34:38.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42392024-11-01T22:34:38.458ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42402024-11-01T22:34:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42412024-11-01T22:34:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42422024-11-01T22:34:38.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42432024-11-01T22:34:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42442024-11-01T22:34:38.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42452024-11-01T22:34:38.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42462024-11-01T22:34:38.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42472024-11-01T22:34:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42482024-11-01T22:34:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42492024-11-01T22:34:38.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42502024-11-01T22:34:38.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42512024-11-01T22:34:38.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42522024-11-01T22:34:38.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42532024-11-01T22:34:38.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42542024-11-01T22:34:38.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42552024-11-01T22:34:38.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.357606ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42562024-11-01T22:34:38.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42572024-11-01T22:34:38.502ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42582024-11-01T22:34:38.502ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42592024-11-01T22:34:38.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42602024-11-01T22:34:38.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42612024-11-01T22:34:38.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42622024-11-01T22:34:38.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42632024-11-01T22:34:38.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42642024-11-01T22:34:38.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42652024-11-01T22:34:38.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42662024-11-01T22:34:38.505ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42672024-11-01T22:34:38.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42682024-11-01T22:34:38.506ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42692024-11-01T22:34:38.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.276051ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42702024-11-01T22:34:38.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42712024-11-01T22:34:38.508ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42722024-11-01T22:34:38.508ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42732024-11-01T22:34:38.508ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.84612ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42742024-11-01T22:34:38.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42752024-11-01T22:34:38.510ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42762024-11-01T22:34:38.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42772024-11-01T22:34:38.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782024-11-01T22:34:38.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42792024-11-01T22:34:38.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42802024-11-01T22:34:38.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42812024-11-01T22:34:38.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42822024-11-01T22:34:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42832024-11-01T22:34:38.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42842024-11-01T22:34:38.514ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42852024-11-01T22:34:38.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42862024-11-01T22:34:38.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42872024-11-01T22:34:38.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42882024-11-01T22:34:38.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42892024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42902024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42912024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42922024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42932024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42942024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42952024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42962024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42972024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42982024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42992024-11-01T22:34:38.521ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43002024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.82263ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43012024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43022024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43032024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43042024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43052024-11-01T22:34:38.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43062024-11-01T22:34:38.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43072024-11-01T22:34:38.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43082024-11-01T22:34:38.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43092024-11-01T22:34:38.526ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43102024-11-01T22:34:38.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43112024-11-01T22:34:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43122024-11-01T22:34:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
43132024-11-01T22:34:38.527ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43142024-11-01T22:34:38.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43152024-11-01T22:34:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43162024-11-01T22:34:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43172024-11-01T22:34:38.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43182024-11-01T22:34:38.532ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.547171ms iteration = 19 status = 0
43192024-11-01T22:34:38.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43202024-11-01T22:34:38.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43212024-11-01T22:34:38.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43222024-11-01T22:34:38.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43232024-11-01T22:34:38.536ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43242024-11-01T22:34:38.536ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.639602ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43252024-11-01T22:34:38.538ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 100.0102ms iteration = 5 status = {"nsuccess":5}
43262024-11-01T22:34:38.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
43272024-11-01T22:34:38.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43282024-11-01T22:34:38.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43292024-11-01T22:34:38.575ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43302024-11-01T22:34:38.575ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43312024-11-01T22:34:38.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43322024-11-01T22:34:38.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43332024-11-01T22:34:38.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43342024-11-01T22:34:38.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43352024-11-01T22:34:38.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362024-11-01T22:34:38.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43372024-11-01T22:34:38.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43382024-11-01T22:34:38.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43392024-11-01T22:34:38.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43402024-11-01T22:34:38.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43412024-11-01T22:34:38.606ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43422024-11-01T22:34:38.625ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
43432024-11-01T22:34:38.625ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43442024-11-01T22:34:38.626ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ead7ff-0967-4375-8548-c3479a3efab9", "content-length": "26", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
43452024-11-01T22:34:38.626ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43462024-11-01T22:34:38.628ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43472024-11-01T22:34:38.629ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43482024-11-01T22:34:38.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43492024-11-01T22:34:38.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43502024-11-01T22:34:38.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b3de99ea-8bb5-47a0-8bf2-8ea5f07635c0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
43512024-11-01T22:34:38.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b3de99ea-8bb5-47a0-8bf2-8ea5f07635c0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
43522024-11-01T22:34:38.679ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.666528ms iteration = 22 status = {"physical_disks_added":0}
43532024-11-01T22:34:38.733ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
43542024-11-01T22:34:38.733ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43552024-11-01T22:34:38.733ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a45a674d-644e-4568-b063-62ed5b1ffb21", "content-length": "26", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
43562024-11-01T22:34:38.733ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43572024-11-01T22:34:38.735ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43582024-11-01T22:34:38.740ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43592024-11-01T22:34:38.741ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43602024-11-01T22:34:38.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fab117b3-c882-49d4-bbe6-aa78a8ebf2f8", "content-length": "372", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
43612024-11-01T22:34:38.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43622024-11-01T22:34:38.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43632024-11-01T22:34:38.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b3de99ea-8bb5-47a0-8bf2-8ea5f07635c0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
43642024-11-01T22:34:38.763ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
43652024-11-01T22:34:38.763ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 324.490075ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
43662024-11-01T22:34:38.789ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43672024-11-01T22:34:38.789ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
43682024-11-01T22:34:38.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43692024-11-01T22:34:38.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43702024-11-01T22:34:38.791ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43712024-11-01T22:34:38.791ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43722024-11-01T22:34:38.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43732024-11-01T22:34:38.791ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43742024-11-01T22:34:38.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43752024-11-01T22:34:38.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43762024-11-01T22:34:38.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43772024-11-01T22:34:38.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43782024-11-01T22:34:38.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43792024-11-01T22:34:38.797ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
43802024-11-01T22:34:38.797ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43812024-11-01T22:34:38.797ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e779c4b-b651-4eda-acf7-ebb6404b29fc", "content-length": "26", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
43822024-11-01T22:34:38.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43832024-11-01T22:34:38.799ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
43842024-11-01T22:34:38.800ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43852024-11-01T22:34:38.800ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43862024-11-01T22:34:38.800ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 361.703867ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43872024-11-01T22:34:38.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43882024-11-01T22:34:38.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43892024-11-01T22:34:38.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43902024-11-01T22:34:38.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43912024-11-01T22:34:38.805ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0e162d0c-648d-4036-8d9c-5ef248eedf53", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43922024-11-01T22:34:38.805ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43932024-11-01T22:34:38.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43942024-11-01T22:34:38.807ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "801ab20c-1373-4c15-a3ff-c622f2e61049", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43952024-11-01T22:34:38.807ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43962024-11-01T22:34:38.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43972024-11-01T22:34:38.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43982024-11-01T22:34:38.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43992024-11-01T22:34:38.810ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44002024-11-01T22:34:38.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 371.575802ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44012024-11-01T22:34:38.824ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44022024-11-01T22:34:38.824ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44032024-11-01T22:34:38.825ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "529e7d83-b731-4b99-8872-1c4cbcba901b", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44042024-11-01T22:34:38.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44052024-11-01T22:34:38.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44062024-11-01T22:34:38.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44072024-11-01T22:34:38.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44082024-11-01T22:34:38.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44092024-11-01T22:34:38.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44102024-11-01T22:34:38.842ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44112024-11-01T22:34:38.842ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44122024-11-01T22:34:38.842ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "54c982a0-e527-4760-8190-16b6b883cbd8", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44132024-11-01T22:34:38.843ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44142024-11-01T22:34:38.844ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.745152ms iteration = 20 status = {}
44152024-11-01T22:34:38.844ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 405.988883ms iteration = 19 status = {}
44162024-11-01T22:34:38.850ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44172024-11-01T22:34:38.851ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "18aea73f-7621-4571-a258-1eae09aeace6", "content-length": "1", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44182024-11-01T22:34:38.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44192024-11-01T22:34:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44202024-11-01T22:34:38.857ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
44212024-11-01T22:34:38.857ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 416.879257ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44222024-11-01T22:34:38.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44232024-11-01T22:34:38.859ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 420.122761ms iteration = 19 status = null
44242024-11-01T22:34:38.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252024-11-01T22:34:38.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44262024-11-01T22:34:38.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44272024-11-01T22:34:38.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44282024-11-01T22:34:38.866ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
44292024-11-01T22:34:38.866ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44302024-11-01T22:34:38.866ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
44312024-11-01T22:34:38.866ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 427.460736ms iteration = 11 status = {"generation":2}
44322024-11-01T22:34:38.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44332024-11-01T22:34:38.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44342024-11-01T22:34:38.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44352024-11-01T22:34:38.879ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44362024-11-01T22:34:38.879ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44372024-11-01T22:34:38.879ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
44382024-11-01T22:34:38.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 440.352635ms iteration = 11 status = {"generation":1}
44392024-11-01T22:34:38.891ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44402024-11-01T22:34:38.891ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 452.281686ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44412024-11-01T22:34:38.903ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44422024-11-01T22:34:38.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6f609744-2dc4-4e94-9a48-76f3b78854aa", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44432024-11-01T22:34:38.904ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44442024-11-01T22:34:38.905ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e2d1dd02-d655-42ba-87cd-ebbf03d62318", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44452024-11-01T22:34:38.905ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44462024-11-01T22:34:38.906ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "905af319-2e84-49c6-847f-bbfa9881d0a9", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44472024-11-01T22:34:38.906ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44482024-11-01T22:34:38.908ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44492024-11-01T22:34:38.908ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 469.561517ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44502024-11-01T22:34:38.969ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44512024-11-01T22:34:38.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "efd93636-f9c7-4bd3-a7a3-274d52dc3f5a", "content-length": "691", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44522024-11-01T22:34:38.969ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44532024-11-01T22:34:38.969ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44542024-11-01T22:34:38.969ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44552024-11-01T22:34:38.971ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 532.746206ms iteration = 19 status = {}
44562024-11-01T22:34:38.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44572024-11-01T22:34:38.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44582024-11-01T22:34:38.995ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
44592024-11-01T22:34:38.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44602024-11-01T22:34:38.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44612024-11-01T22:34:39.005ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44622024-11-01T22:34:39.005ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4d968f3-676a-4cd4-8b4f-c5cbb8e4df99", "content-length": "134", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44632024-11-01T22:34:39.005ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44642024-11-01T22:34:39.005ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
44652024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44662024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44672024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44682024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44692024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44702024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44712024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44722024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44732024-11-01T22:34:39.006ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
44742024-11-01T22:34:39.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44752024-11-01T22:34:39.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44762024-11-01T22:34:39.009ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44772024-11-01T22:34:39.009ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "af52d783-62c0-42a9-a5ac-3917a6946218", "content-length": "2", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44782024-11-01T22:34:39.009ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44792024-11-01T22:34:39.009ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "871bb06d-2c88-4526-a4b5-5264a13d1351", "content-length": "52", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44802024-11-01T22:34:39.009ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
44812024-11-01T22:34:39.009ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44822024-11-01T22:34:39.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bdcec516-8c48-4a2e-a49e-f040fbb6d0ac", "date": "Fri, 01 Nov 2024 22:34:38 GMT"} })
44832024-11-01T22:34:39.109ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
44842024-11-01T22:34:39.109ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44852024-11-01T22:34:39.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0586994f-246f-426c-a156-bb187c0c054e", "content-length": "682", "date": "Fri, 01 Nov 2024 22:34:39 GMT"} })
44862024-11-01T22:34:39.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44872024-11-01T22:34:39.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44882024-11-01T22:34:39.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44892024-11-01T22:34:39.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44902024-11-01T22:34:39.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44912024-11-01T22:34:39.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44922024-11-01T22:34:39.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44932024-11-01T22:34:39.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44942024-11-01T22:34:39.127ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.51876ms iteration = 19 status = {}
44952024-11-01T22:34:39.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 8c5b295a-b0a4-4aca-8bb3-4e198f43084c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
44962024-11-01T22:34:39.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 8c5b295a-b0a4-4aca-8bb3-4e198f43084c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
44972024-11-01T22:34:39.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 8c5b295a-b0a4-4aca-8bb3-4e198f43084c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
44982024-11-01T22:34:39.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c12f7a3b-ede0-4fb6-a12c-a17f07646604 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
44992024-11-01T22:34:39.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c12f7a3b-ede0-4fb6-a12c-a17f07646604 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45002024-11-01T22:34:39.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c12f7a3b-ede0-4fb6-a12c-a17f07646604 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45012024-11-01T22:34:40.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e3df33f1-8f7d-41a9-b3e8-84398aec5b3f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45022024-11-01T22:34:40.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e3df33f1-8f7d-41a9-b3e8-84398aec5b3f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45032024-11-01T22:34:40.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e3df33f1-8f7d-41a9-b3e8-84398aec5b3f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45042024-11-01T22:34:41.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8b78dcb-cf1d-4208-9819-5ea5ea2f8c49 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45052024-11-01T22:34:41.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8b78dcb-cf1d-4208-9819-5ea5ea2f8c49 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45062024-11-01T22:34:41.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8b78dcb-cf1d-4208-9819-5ea5ea2f8c49 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45072024-11-01T22:34:42.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41d440fd-fc7a-4385-a6e2-a86102be10aa roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45082024-11-01T22:34:42.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41d440fd-fc7a-4385-a6e2-a86102be10aa resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45092024-11-01T22:34:42.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41d440fd-fc7a-4385-a6e2-a86102be10aa response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45102024-11-01T22:34:43.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 8d6cf406-6aad-4854-9d30-0dbc33bee108 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
45112024-11-01T22:34:43.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4947face-7c5d-44b8-8461-419de03d4c5e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45122024-11-01T22:34:43.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4947face-7c5d-44b8-8461-419de03d4c5e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45132024-11-01T22:34:43.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4947face-7c5d-44b8-8461-419de03d4c5e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45142024-11-01T22:34:44.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e350c3f4-efff-4b9e-bfd9-51b2bc5b1bd6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45152024-11-01T22:34:44.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e350c3f4-efff-4b9e-bfd9-51b2bc5b1bd6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45162024-11-01T22:34:44.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e350c3f4-efff-4b9e-bfd9-51b2bc5b1bd6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45172024-11-01T22:34:45.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b55fd4ee-22da-4bab-88ed-9b3f536a7367 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45182024-11-01T22:34:45.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b55fd4ee-22da-4bab-88ed-9b3f536a7367 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45192024-11-01T22:34:45.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b55fd4ee-22da-4bab-88ed-9b3f536a7367 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45202024-11-01T22:34:46.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53fb7d51-d339-4a89-a17c-ce20a26bba89 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45212024-11-01T22:34:46.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53fb7d51-d339-4a89-a17c-ce20a26bba89 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45222024-11-01T22:34:46.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 53fb7d51-d339-4a89-a17c-ce20a26bba89 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45232024-11-01T22:34:47.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b259e65-6b22-4344-b57e-3f478d940705 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45242024-11-01T22:34:47.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b259e65-6b22-4344-b57e-3f478d940705 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45252024-11-01T22:34:47.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6b259e65-6b22-4344-b57e-3f478d940705 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45262024-11-01T22:34:48.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 9f8a91cf-ff79-4768-ae4c-777c4800f5d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
45272024-11-01T22:34:48.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 9f8a91cf-ff79-4768-ae4c-777c4800f5d2 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
45282024-11-01T22:34:48.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 9f8a91cf-ff79-4768-ae4c-777c4800f5d2 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
45292024-11-01T22:34:48.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 37609504-df86-48c6-a8bf-35f8ef33ff65 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
45302024-11-01T22:34:48.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 37609504-df86-48c6-a8bf-35f8ef33ff65 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
45312024-11-01T22:34:48.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59244 req_id = 37609504-df86-48c6-a8bf-35f8ef33ff65 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
45322024-11-01T22:34:48.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
45332024-11-01T22:34:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
45342024-11-01T22:34:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45352024-11-01T22:34:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45362024-11-01T22:34:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45372024-11-01T22:34:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45382024-11-01T22:34:48.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45392024-11-01T22:34:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45402024-11-01T22:34:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45412024-11-01T22:34:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45422024-11-01T22:34:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45432024-11-01T22:34:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45442024-11-01T22:34:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452024-11-01T22:34:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
45462024-11-01T22:34:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45472024-11-01T22:34:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45482024-11-01T22:34:48.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
45492024-11-01T22:34:48.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.477286ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
45502024-11-01T22:34:48.472ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45512024-11-01T22:34:48.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45522024-11-01T22:34:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.027068ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45532024-11-01T22:34:48.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68909d22-78f7-428d-b4ad-9af114e2718a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45542024-11-01T22:34:48.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68909d22-78f7-428d-b4ad-9af114e2718a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45552024-11-01T22:34:48.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68909d22-78f7-428d-b4ad-9af114e2718a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45562024-11-01T22:34:50.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 45f12df9-1a03-461b-a374-8acf6d2c6253 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45572024-11-01T22:34:50.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 45f12df9-1a03-461b-a374-8acf6d2c6253 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45582024-11-01T22:34:50.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 45f12df9-1a03-461b-a374-8acf6d2c6253 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45592024-11-01T22:34:51.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99a78fc5-ff1b-4770-a85b-c4cac615e745 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45602024-11-01T22:34:51.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99a78fc5-ff1b-4770-a85b-c4cac615e745 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45612024-11-01T22:34:51.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99a78fc5-ff1b-4770-a85b-c4cac615e745 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45622024-11-01T22:34:52.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c46940d6-7dae-4090-8f7e-1c9cbbe85071 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45632024-11-01T22:34:52.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c46940d6-7dae-4090-8f7e-1c9cbbe85071 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45642024-11-01T22:34:52.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c46940d6-7dae-4090-8f7e-1c9cbbe85071 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45652024-11-01T22:34:53.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fb2a82c8-7967-4022-9d75-b4bfe997a505 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45662024-11-01T22:34:53.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fb2a82c8-7967-4022-9d75-b4bfe997a505 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45672024-11-01T22:34:53.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fb2a82c8-7967-4022-9d75-b4bfe997a505 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45682024-11-01T22:34:54.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4e217c93-0ddf-497c-a59e-cb7732667781 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45692024-11-01T22:34:54.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4e217c93-0ddf-497c-a59e-cb7732667781 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45702024-11-01T22:34:54.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4e217c93-0ddf-497c-a59e-cb7732667781 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45712024-11-01T22:34:55.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c36d13ec-3446-4dac-b770-5e843df279d0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45722024-11-01T22:34:55.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c36d13ec-3446-4dac-b770-5e843df279d0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45732024-11-01T22:34:55.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c36d13ec-3446-4dac-b770-5e843df279d0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45742024-11-01T22:34:56.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 175ae1b8-fc29-44e5-9b1b-ac321c9fb0a7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45752024-11-01T22:34:56.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 175ae1b8-fc29-44e5-9b1b-ac321c9fb0a7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45762024-11-01T22:34:56.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 175ae1b8-fc29-44e5-9b1b-ac321c9fb0a7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45772024-11-01T22:34:57.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c074cd0d-f43e-4885-8d6f-d7f378d4dcbe roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45782024-11-01T22:34:57.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c074cd0d-f43e-4885-8d6f-d7f378d4dcbe resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45792024-11-01T22:34:57.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c074cd0d-f43e-4885-8d6f-d7f378d4dcbe response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45802024-11-01T22:34:58.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1339 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = be4b3358-f35c-479f-b86a-eecf4aa2e7d5 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
45812024-11-01T22:34:58.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6fe50632-c701-44fd-b9de-c79233e95be4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45822024-11-01T22:34:58.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6fe50632-c701-44fd-b9de-c79233e95be4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45832024-11-01T22:34:58.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6fe50632-c701-44fd-b9de-c79233e95be4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
45842024-11-01T22:34:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
45852024-11-01T22:34:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45862024-11-01T22:34:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
45872024-11-01T22:34:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45882024-11-01T22:34:58.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45892024-11-01T22:34:58.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45902024-11-01T22:34:58.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912024-11-01T22:34:58.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45922024-11-01T22:34:58.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45932024-11-01T22:34:58.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45942024-11-01T22:34:58.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45952024-11-01T22:34:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45962024-11-01T22:34:58.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972024-11-01T22:34:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
45982024-11-01T22:34:58.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45992024-11-01T22:34:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46002024-11-01T22:34:58.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
46012024-11-01T22:34:58.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.793563ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
46022024-11-01T22:34:58.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46032024-11-01T22:34:58.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46042024-11-01T22:34:58.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.60364ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46052024-11-01T22:34:59.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3195b555-b9a3-49fc-8f1d-f75dddd0ec5b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46062024-11-01T22:34:59.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3195b555-b9a3-49fc-8f1d-f75dddd0ec5b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46072024-11-01T22:34:59.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3195b555-b9a3-49fc-8f1d-f75dddd0ec5b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46082024-11-01T22:35:00.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1110e4b2-5a58-499b-8277-73dbe730028d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46092024-11-01T22:35:00.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1110e4b2-5a58-499b-8277-73dbe730028d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46102024-11-01T22:35:00.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1110e4b2-5a58-499b-8277-73dbe730028d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46112024-11-01T22:35:01.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df9b92b3-9646-4cf8-b07a-3850b4e682b5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46122024-11-01T22:35:01.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df9b92b3-9646-4cf8-b07a-3850b4e682b5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46132024-11-01T22:35:01.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df9b92b3-9646-4cf8-b07a-3850b4e682b5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46142024-11-01T22:35:02.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3feccfa8-518b-4568-b45f-a0e01cbc7dae roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46152024-11-01T22:35:02.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3feccfa8-518b-4568-b45f-a0e01cbc7dae resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46162024-11-01T22:35:02.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3feccfa8-518b-4568-b45f-a0e01cbc7dae response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46172024-11-01T22:35:03.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef684df0-6425-48f5-9721-9c12d2d37533 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46182024-11-01T22:35:03.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef684df0-6425-48f5-9721-9c12d2d37533 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46192024-11-01T22:35:03.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef684df0-6425-48f5-9721-9c12d2d37533 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46202024-11-01T22:35:04.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 303590f3-089d-4e19-acb1-1a0478eaa845 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46212024-11-01T22:35:04.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 303590f3-089d-4e19-acb1-1a0478eaa845 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46222024-11-01T22:35:04.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 303590f3-089d-4e19-acb1-1a0478eaa845 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46232024-11-01T22:35:05.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 38ee6c36-1a27-4a3d-9baa-8c25a9b4d4c8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46242024-11-01T22:35:05.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 38ee6c36-1a27-4a3d-9baa-8c25a9b4d4c8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46252024-11-01T22:35:05.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 38ee6c36-1a27-4a3d-9baa-8c25a9b4d4c8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46262024-11-01T22:35:06.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c815a5f-5ab4-4702-a0e9-b81ab2c02a80 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46272024-11-01T22:35:06.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c815a5f-5ab4-4702-a0e9-b81ab2c02a80 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46282024-11-01T22:35:06.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c815a5f-5ab4-4702-a0e9-b81ab2c02a80 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46292024-11-01T22:35:07.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aa2459a6-71f5-47fd-9a1f-b054ba7759ad roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46302024-11-01T22:35:07.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aa2459a6-71f5-47fd-9a1f-b054ba7759ad resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46312024-11-01T22:35:07.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aa2459a6-71f5-47fd-9a1f-b054ba7759ad response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46322024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
46332024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
46342024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 26.21\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46352024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46362024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
46372024-11-01T22:35:08.439ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46382024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46392024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46402024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
46412024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46422024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
46432024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
46442024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46452024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
46462024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46472024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46482024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
46492024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46502024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
46512024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46522024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
46532024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.42\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46542024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
46552024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
46562024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46572024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.58\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
46582024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
46592024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
46602024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46612024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
46622024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.56\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
46632024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46642024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
46652024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
46662024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46672024-11-01T22:35:08.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7d33207b-aee4-45fd-b54d-bc96aaba82a9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46682024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46692024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46702024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46712024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46722024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46732024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46742024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46752024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46762024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46772024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46782024-11-01T22:35:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46792024-11-01T22:35:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46802024-11-01T22:35:08.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7d33207b-aee4-45fd-b54d-bc96aaba82a9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
46812024-11-01T22:35:08.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-11-01T22:35:08.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832024-11-01T22:35:08.443ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.538846ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46842024-11-01T22:35:08.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46852024-11-01T22:35:08.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46862024-11-01T22:35:08.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46872024-11-01T22:35:08.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46882024-11-01T22:35:08.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46892024-11-01T22:35:08.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46902024-11-01T22:35:08.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46912024-11-01T22:35:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46922024-11-01T22:35:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46932024-11-01T22:35:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46942024-11-01T22:35:08.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46952024-11-01T22:35:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46962024-11-01T22:35:08.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46972024-11-01T22:35:08.447ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 476333592 } })
46982024-11-01T22:35:08.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46992024-11-01T22:35:08.447ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
47002024-11-01T22:35:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47012024-11-01T22:35:08.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47022024-11-01T22:35:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47032024-11-01T22:35:08.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47042024-11-01T22:35:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47052024-11-01T22:35:08.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7d33207b-aee4-45fd-b54d-bc96aaba82a9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
47062024-11-01T22:35:08.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 479640967 } })
47072024-11-01T22:35:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47082024-11-01T22:35:08.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47092024-11-01T22:35:08.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
47102024-11-01T22:35:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47112024-11-01T22:35:08.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 12.350013ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47122024-11-01T22:35:08.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.942236ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47132024-11-01T22:35:08.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47142024-11-01T22:35:08.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47152024-11-01T22:35:08.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47162024-11-01T22:35:08.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47172024-11-01T22:35:08.460ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 489703233 } })
47182024-11-01T22:35:08.460ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
47192024-11-01T22:35:08.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47202024-11-01T22:35:08.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47212024-11-01T22:35:08.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47222024-11-01T22:35:08.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47232024-11-01T22:35:08.472ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.806829ms iteration = 23 status = {"physical_disks_added":0}
47242024-11-01T22:35:08.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47252024-11-01T22:35:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47262024-11-01T22:35:08.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47272024-11-01T22:35:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47282024-11-01T22:35:08.481ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47292024-11-01T22:35:08.481ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47302024-11-01T22:35:08.481ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47312024-11-01T22:35:08.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47322024-11-01T22:35:08.483ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47332024-11-01T22:35:08.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47342024-11-01T22:35:08.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47352024-11-01T22:35:08.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47362024-11-01T22:35:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47372024-11-01T22:35:08.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47382024-11-01T22:35:08.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47392024-11-01T22:35:08.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
47402024-11-01T22:35:08.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47412024-11-01T22:35:08.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47422024-11-01T22:35:08.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47432024-11-01T22:35:08.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47442024-11-01T22:35:08.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47452024-11-01T22:35:08.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47462024-11-01T22:35:08.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47472024-11-01T22:35:08.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
47482024-11-01T22:35:08.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47492024-11-01T22:35:08.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47502024-11-01T22:35:08.495ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.751584ms iteration = 20 status = 0
47512024-11-01T22:35:08.497ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47522024-11-01T22:35:08.497ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.362093ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47532024-11-01T22:35:08.500ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
47542024-11-01T22:35:08.500ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.819332ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
47552024-11-01T22:35:08.511ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47562024-11-01T22:35:08.511ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47572024-11-01T22:35:08.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47582024-11-01T22:35:08.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47592024-11-01T22:35:08.555ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47602024-11-01T22:35:08.555ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47612024-11-01T22:35:08.555ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.039862ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47622024-11-01T22:35:08.561ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
47632024-11-01T22:35:08.561ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47642024-11-01T22:35:08.562ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78b70ebf-92f0-4386-af88-7cb6255ecdef", "content-length": "26", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
47652024-11-01T22:35:08.562ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47662024-11-01T22:35:08.563ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
47672024-11-01T22:35:08.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47682024-11-01T22:35:08.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47692024-11-01T22:35:08.651ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
47702024-11-01T22:35:08.651ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47712024-11-01T22:35:08.651ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e69b19a2-57c7-4018-99ce-af517fdc90b7", "content-length": "26", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
47722024-11-01T22:35:08.651ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47732024-11-01T22:35:08.653ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47742024-11-01T22:35:08.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
47752024-11-01T22:35:08.656ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47762024-11-01T22:35:08.656ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abf3605c-05dd-465a-8aab-63053445bd51", "content-length": "26", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
47772024-11-01T22:35:08.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47782024-11-01T22:35:08.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47792024-11-01T22:35:08.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47802024-11-01T22:35:08.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47812024-11-01T22:35:08.685ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47822024-11-01T22:35:08.685ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47832024-11-01T22:35:08.686ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "320034ab-689d-429c-bb9b-6d45923e371d", "content-length": "372", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
47842024-11-01T22:35:08.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47852024-11-01T22:35:08.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47862024-11-01T22:35:08.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47872024-11-01T22:35:08.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47882024-11-01T22:35:08.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47892024-11-01T22:35:08.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47902024-11-01T22:35:08.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47912024-11-01T22:35:08.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47922024-11-01T22:35:08.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47932024-11-01T22:35:08.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47942024-11-01T22:35:08.740ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
47952024-11-01T22:35:08.740ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47962024-11-01T22:35:08.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "71f19974-1218-4e34-b717-f1feea952125", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
47972024-11-01T22:35:08.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47982024-11-01T22:35:08.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47992024-11-01T22:35:08.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48002024-11-01T22:35:08.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48012024-11-01T22:35:08.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48022024-11-01T22:35:08.746ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 306.612889ms iteration = 20 status = {}
48032024-11-01T22:35:08.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48042024-11-01T22:35:08.749ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48052024-11-01T22:35:08.749ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48062024-11-01T22:35:08.749ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c4eb2d96-d074-48d3-ad8f-7ebd85ac21ee", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48072024-11-01T22:35:08.751ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 312.648306ms iteration = 21 status = {}
48082024-11-01T22:35:08.762ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48092024-11-01T22:35:08.763ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a81dd0f-220a-4590-a560-12ca756389fe", "content-length": "1", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48102024-11-01T22:35:08.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48112024-11-01T22:35:08.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48122024-11-01T22:35:08.818ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48132024-11-01T22:35:08.818ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d688bbaa-1d89-4166-8ef6-f5a0cf19f0c8", "content-length": "691", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48142024-11-01T22:35:08.818ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48152024-11-01T22:35:08.818ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48162024-11-01T22:35:08.818ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48172024-11-01T22:35:08.820ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 381.033854ms iteration = 20 status = {}
48182024-11-01T22:35:08.820ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 381.013474ms iteration = 20 status = null
48192024-11-01T22:35:08.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48202024-11-01T22:35:08.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48212024-11-01T22:35:08.835ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
48222024-11-01T22:35:08.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48232024-11-01T22:35:08.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48242024-11-01T22:35:08.846ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48252024-11-01T22:35:08.846ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a94ed73f-039a-4a76-8aa9-155197f39630", "content-length": "134", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48262024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48272024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
48282024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48292024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48302024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48312024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48322024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48332024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48342024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48352024-11-01T22:35:08.846ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48362024-11-01T22:35:08.847ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
48372024-11-01T22:35:08.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48382024-11-01T22:35:08.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48392024-11-01T22:35:08.849ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48402024-11-01T22:35:08.849ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e479ab49-ba82-4314-9ee4-781d3be141e5", "content-length": "2", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48412024-11-01T22:35:08.849ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48422024-11-01T22:35:08.849ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7755e37c-8a8c-4ba1-ac21-f6d8379aec77", "content-length": "52", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48432024-11-01T22:35:08.849ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
48442024-11-01T22:35:08.849ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48452024-11-01T22:35:08.952ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f2c4f56f-1aa6-4ad3-af31-021bf1930531", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48462024-11-01T22:35:08.952ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
48472024-11-01T22:35:08.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48482024-11-01T22:35:08.957ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0949b01e-c27a-4edf-bd7e-16a06b1bb6ff", "content-length": "682", "date": "Fri, 01 Nov 2024 22:35:08 GMT"} })
48492024-11-01T22:35:08.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48502024-11-01T22:35:08.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48512024-11-01T22:35:08.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48522024-11-01T22:35:08.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48532024-11-01T22:35:08.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48542024-11-01T22:35:08.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48552024-11-01T22:35:08.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48562024-11-01T22:35:08.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48572024-11-01T22:35:08.974ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 534.889002ms iteration = 20 status = {}
48582024-11-01T22:35:09.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cfd34f25-f3e2-4dcb-844e-f9f412b17c2e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48592024-11-01T22:35:09.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cfd34f25-f3e2-4dcb-844e-f9f412b17c2e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48602024-11-01T22:35:09.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cfd34f25-f3e2-4dcb-844e-f9f412b17c2e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48612024-11-01T22:35:09.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 82ba0d06-68d2-4902-b574-b22de5dc09f8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
48622024-11-01T22:35:09.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 82ba0d06-68d2-4902-b574-b22de5dc09f8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
48632024-11-01T22:35:09.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 82ba0d06-68d2-4902-b574-b22de5dc09f8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
48642024-11-01T22:35:10.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d08e7027-b486-4891-8590-631e6b26aae2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48652024-11-01T22:35:10.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d08e7027-b486-4891-8590-631e6b26aae2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48662024-11-01T22:35:10.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d08e7027-b486-4891-8590-631e6b26aae2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48672024-11-01T22:35:11.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d7761c01-643c-46b4-b352-485aa9350897 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48682024-11-01T22:35:11.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d7761c01-643c-46b4-b352-485aa9350897 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48692024-11-01T22:35:11.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d7761c01-643c-46b4-b352-485aa9350897 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48702024-11-01T22:35:12.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e45dc6a5-2add-4e44-9a98-c873667a1846 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48712024-11-01T22:35:12.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e45dc6a5-2add-4e44-9a98-c873667a1846 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48722024-11-01T22:35:12.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e45dc6a5-2add-4e44-9a98-c873667a1846 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48732024-11-01T22:35:13.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1558 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 9031f23a-9b92-484c-96af-efc8ebc3501d response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
48742024-11-01T22:35:13.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a3cbfb6b-054e-4ac5-87b5-299e01f3e487 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48752024-11-01T22:35:13.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a3cbfb6b-054e-4ac5-87b5-299e01f3e487 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48762024-11-01T22:35:13.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a3cbfb6b-054e-4ac5-87b5-299e01f3e487 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48772024-11-01T22:35:14.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e76c971-c1e3-4baa-8aa9-453aa784432a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48782024-11-01T22:35:14.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e76c971-c1e3-4baa-8aa9-453aa784432a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48792024-11-01T22:35:14.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3e76c971-c1e3-4baa-8aa9-453aa784432a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48802024-11-01T22:35:15.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20a7d170-38a2-40ae-bb6c-3c8a9699fac2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48812024-11-01T22:35:15.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20a7d170-38a2-40ae-bb6c-3c8a9699fac2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48822024-11-01T22:35:15.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20a7d170-38a2-40ae-bb6c-3c8a9699fac2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48832024-11-01T22:35:16.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 11bf33d5-59e8-4f61-84d7-72dcff09bf1c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48842024-11-01T22:35:16.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 11bf33d5-59e8-4f61-84d7-72dcff09bf1c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48852024-11-01T22:35:16.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 11bf33d5-59e8-4f61-84d7-72dcff09bf1c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48862024-11-01T22:35:17.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6a02ef0c-90d3-4589-a9e4-f41ebd86c00b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48872024-11-01T22:35:17.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6a02ef0c-90d3-4589-a9e4-f41ebd86c00b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48882024-11-01T22:35:17.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6a02ef0c-90d3-4589-a9e4-f41ebd86c00b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
48892024-11-01T22:35:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
48902024-11-01T22:35:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
48912024-11-01T22:35:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48922024-11-01T22:35:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48932024-11-01T22:35:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48942024-11-01T22:35:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48952024-11-01T22:35:18.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48962024-11-01T22:35:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48972024-11-01T22:35:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48982024-11-01T22:35:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48992024-11-01T22:35:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49002024-11-01T22:35:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49012024-11-01T22:35:18.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49022024-11-01T22:35:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
49032024-11-01T22:35:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49042024-11-01T22:35:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49052024-11-01T22:35:18.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
49062024-11-01T22:35:18.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.528931ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
49072024-11-01T22:35:18.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49082024-11-01T22:35:18.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49092024-11-01T22:35:18.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.771364ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49102024-11-01T22:35:18.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8ea507f2-69aa-4ebf-8203-2aa55c0258c6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49112024-11-01T22:35:18.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8ea507f2-69aa-4ebf-8203-2aa55c0258c6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49122024-11-01T22:35:18.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8ea507f2-69aa-4ebf-8203-2aa55c0258c6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49132024-11-01T22:35:19.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 828b88f8-0dc6-4f0d-8070-0e800bc70ce7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49142024-11-01T22:35:19.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 828b88f8-0dc6-4f0d-8070-0e800bc70ce7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49152024-11-01T22:35:19.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 828b88f8-0dc6-4f0d-8070-0e800bc70ce7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49162024-11-01T22:35:20.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0ee4f3a6-a93e-417c-b029-70965f53fa99 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49172024-11-01T22:35:20.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0ee4f3a6-a93e-417c-b029-70965f53fa99 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49182024-11-01T22:35:20.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0ee4f3a6-a93e-417c-b029-70965f53fa99 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49192024-11-01T22:35:21.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6316c47d-77ce-45e9-b2ea-560580d8d353 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49202024-11-01T22:35:21.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6316c47d-77ce-45e9-b2ea-560580d8d353 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49212024-11-01T22:35:21.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6316c47d-77ce-45e9-b2ea-560580d8d353 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49222024-11-01T22:35:22.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 106a8cd8-3919-421f-9cc4-c2a94383e0e8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49232024-11-01T22:35:22.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 106a8cd8-3919-421f-9cc4-c2a94383e0e8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49242024-11-01T22:35:22.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 106a8cd8-3919-421f-9cc4-c2a94383e0e8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49252024-11-01T22:35:23.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f0811f4f-d4aa-45bf-835f-9763ff61196b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49262024-11-01T22:35:23.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f0811f4f-d4aa-45bf-835f-9763ff61196b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49272024-11-01T22:35:23.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f0811f4f-d4aa-45bf-835f-9763ff61196b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49282024-11-01T22:35:24.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51db64e5-0682-4771-aaf5-215aaee9dfcd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49292024-11-01T22:35:24.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51db64e5-0682-4771-aaf5-215aaee9dfcd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49302024-11-01T22:35:24.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51db64e5-0682-4771-aaf5-215aaee9dfcd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49312024-11-01T22:35:25.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99dd2f8b-68f0-4196-bf2a-144e0a347904 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49322024-11-01T22:35:25.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99dd2f8b-68f0-4196-bf2a-144e0a347904 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49332024-11-01T22:35:25.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99dd2f8b-68f0-4196-bf2a-144e0a347904 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49342024-11-01T22:35:26.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 17d18c21-4cf7-42e2-8212-e829fb64b252 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49352024-11-01T22:35:26.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 17d18c21-4cf7-42e2-8212-e829fb64b252 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49362024-11-01T22:35:26.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 17d18c21-4cf7-42e2-8212-e829fb64b252 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49372024-11-01T22:35:27.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63fd3171-7942-4e83-9d7f-476430458478 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49382024-11-01T22:35:27.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63fd3171-7942-4e83-9d7f-476430458478 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49392024-11-01T22:35:27.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63fd3171-7942-4e83-9d7f-476430458478 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49402024-11-01T22:35:28.193ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1378 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 7904f030-48ce-4207-86ba-d02bbd8aaed7 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
49412024-11-01T22:35:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
49422024-11-01T22:35:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
49432024-11-01T22:35:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49442024-11-01T22:35:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49452024-11-01T22:35:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49462024-11-01T22:35:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49472024-11-01T22:35:28.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49482024-11-01T22:35:28.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49492024-11-01T22:35:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49502024-11-01T22:35:28.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.067241ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49512024-11-01T22:35:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49522024-11-01T22:35:28.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49532024-11-01T22:35:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49542024-11-01T22:35:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49552024-11-01T22:35:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49562024-11-01T22:35:28.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49572024-11-01T22:35:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
49582024-11-01T22:35:28.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49592024-11-01T22:35:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49602024-11-01T22:35:28.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
49612024-11-01T22:35:28.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.070725ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
49622024-11-01T22:35:28.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b829c082-2444-40aa-aca1-20e3c15b48b8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49632024-11-01T22:35:28.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b829c082-2444-40aa-aca1-20e3c15b48b8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49642024-11-01T22:35:28.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b829c082-2444-40aa-aca1-20e3c15b48b8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49652024-11-01T22:35:29.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1e6f796-786a-49bb-b13d-02df62d8736e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49662024-11-01T22:35:29.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1e6f796-786a-49bb-b13d-02df62d8736e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49672024-11-01T22:35:29.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1e6f796-786a-49bb-b13d-02df62d8736e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49682024-11-01T22:35:30.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8bef90b5-3500-4ca2-97ef-0c2089f2d4fb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49692024-11-01T22:35:30.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8bef90b5-3500-4ca2-97ef-0c2089f2d4fb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49702024-11-01T22:35:30.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8bef90b5-3500-4ca2-97ef-0c2089f2d4fb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49712024-11-01T22:35:31.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ff943aa-9f33-4b4b-9ff4-6aa537f41f2f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49722024-11-01T22:35:31.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ff943aa-9f33-4b4b-9ff4-6aa537f41f2f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49732024-11-01T22:35:31.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9ff943aa-9f33-4b4b-9ff4-6aa537f41f2f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49742024-11-01T22:35:33.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ebc0e24b-a121-4126-bc97-486cbd159f2e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49752024-11-01T22:35:33.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ebc0e24b-a121-4126-bc97-486cbd159f2e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49762024-11-01T22:35:33.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ebc0e24b-a121-4126-bc97-486cbd159f2e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49772024-11-01T22:35:34.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 78401783-bc9b-4397-9d8d-3766eb6d2723 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49782024-11-01T22:35:34.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 78401783-bc9b-4397-9d8d-3766eb6d2723 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49792024-11-01T22:35:34.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 78401783-bc9b-4397-9d8d-3766eb6d2723 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49802024-11-01T22:35:35.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a5277746-1f89-4e30-8d4d-7837913a467f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49812024-11-01T22:35:35.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a5277746-1f89-4e30-8d4d-7837913a467f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49822024-11-01T22:35:35.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a5277746-1f89-4e30-8d4d-7837913a467f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49832024-11-01T22:35:36.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e57f52b0-5dd2-4eca-ad3d-a51f4c70ceab roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49842024-11-01T22:35:36.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e57f52b0-5dd2-4eca-ad3d-a51f4c70ceab resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49852024-11-01T22:35:36.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e57f52b0-5dd2-4eca-ad3d-a51f4c70ceab response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49862024-11-01T22:35:37.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 54fe1616-6e9d-4a28-8730-358be8b02310 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49872024-11-01T22:35:37.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 54fe1616-6e9d-4a28-8730-358be8b02310 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49882024-11-01T22:35:37.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 54fe1616-6e9d-4a28-8730-358be8b02310 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49892024-11-01T22:35:38.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 894e76eb-f90e-44c4-b567-0638d78e611f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49902024-11-01T22:35:38.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 894e76eb-f90e-44c4-b567-0638d78e611f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49912024-11-01T22:35:38.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 894e76eb-f90e-44c4-b567-0638d78e611f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
49922024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
49932024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
49942024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 22.411\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49952024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49962024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
49972024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49982024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
49992024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50002024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
50012024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50022024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
50032024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50042024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
50052024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
50062024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50072024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
50082024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50092024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50102024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
50112024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.99\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50122024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
50132024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
50142024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50152024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50162024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50172024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
50182024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
50192024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50202024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.32\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
50212024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
50222024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
50232024-11-01T22:35:38.439ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50242024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.2\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
50252024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50262024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
50272024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
50282024-11-01T22:35:38.439ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
50292024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
50302024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
50312024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
50322024-11-01T22:35:38.439ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
50332024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.47\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
50342024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
50352024-11-01T22:35:38.439ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50362024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
50372024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50382024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
50392024-11-01T22:35:38.439ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
50402024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
50412024-11-01T22:35:38.439ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
50422024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50432024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
50442024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50452024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50462024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
50472024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50482024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
50492024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50502024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
50512024-11-01T22:35:38.439ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:25:38.439489784 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50522024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
50532024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50542024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
50552024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50562024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
50572024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
50582024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
50592024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
50602024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50612024-11-01T22:35:38.439ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50622024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50632024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50642024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50652024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50662024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50672024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50682024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50692024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50702024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50712024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50722024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50732024-11-01T22:35:38.440ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
50742024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
50752024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50762024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50772024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50782024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50792024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
50802024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50812024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50822024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50832024-11-01T22:35:38.440ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 468776754 } })
50842024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50852024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50862024-11-01T22:35:38.440ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 468828025 } })
50872024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
50882024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.107418ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
50892024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
50902024-11-01T22:35:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.176629ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
50912024-11-01T22:35:38.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50922024-11-01T22:35:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50932024-11-01T22:35:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.292305ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50942024-11-01T22:35:38.443ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.071271ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
50952024-11-01T22:35:38.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 472715294 } })
50962024-11-01T22:35:38.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
50972024-11-01T22:35:38.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50982024-11-01T22:35:38.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50992024-11-01T22:35:38.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51002024-11-01T22:35:38.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51012024-11-01T22:35:38.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51022024-11-01T22:35:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51032024-11-01T22:35:38.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51042024-11-01T22:35:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51052024-11-01T22:35:38.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51062024-11-01T22:35:38.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51072024-11-01T22:35:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51082024-11-01T22:35:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51092024-11-01T22:35:38.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51102024-11-01T22:35:38.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51112024-11-01T22:35:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51122024-11-01T22:35:38.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51132024-11-01T22:35:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51142024-11-01T22:35:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51152024-11-01T22:35:38.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51162024-11-01T22:35:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51172024-11-01T22:35:38.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51182024-11-01T22:35:38.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51192024-11-01T22:35:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51202024-11-01T22:35:38.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51212024-11-01T22:35:38.451ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51222024-11-01T22:35:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51232024-11-01T22:35:38.454ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51242024-11-01T22:35:38.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-11-01T22:35:38.455ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:25:38.439489784 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51262024-11-01T22:35:38.455ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.048242ms iteration = 11 status = {"expiration":"2024-11-01T22:25:38.439489784Z","pruned":[]}
51272024-11-01T22:35:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
51282024-11-01T22:35:38.456ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51292024-11-01T22:35:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51302024-11-01T22:35:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51312024-11-01T22:35:38.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51322024-11-01T22:35:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51332024-11-01T22:35:38.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51342024-11-01T22:35:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51352024-11-01T22:35:38.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51362024-11-01T22:35:38.459ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 488344723 } })
51372024-11-01T22:35:38.459ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
51382024-11-01T22:35:38.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51392024-11-01T22:35:38.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51402024-11-01T22:35:38.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51412024-11-01T22:35:38.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51422024-11-01T22:35:38.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51432024-11-01T22:35:38.464ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 493244710 } })
51442024-11-01T22:35:38.464ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
51452024-11-01T22:35:38.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51462024-11-01T22:35:38.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51472024-11-01T22:35:38.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51482024-11-01T22:35:38.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51492024-11-01T22:35:38.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51502024-11-01T22:35:38.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51512024-11-01T22:35:38.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51522024-11-01T22:35:38.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51532024-11-01T22:35:38.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51542024-11-01T22:35:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51552024-11-01T22:35:38.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562024-11-01T22:35:38.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51572024-11-01T22:35:38.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51582024-11-01T22:35:38.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
51592024-11-01T22:35:38.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51602024-11-01T22:35:38.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51612024-11-01T22:35:38.474ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(2fdb78ca-5017-43b2-9ee5-ea8846e04882, 0), (511f349d-08c2-4524-a15c-cbf80c6399cc, 0), (c615b805-18f1-452f-a5af-bbfaacaae3ef, 0), (a160f501-189e-490d-a526-09fd9176e698, 0)] collection_id = 2fdb78ca-5017-43b2-9ee5-ea8846e04882
51622024-11-01T22:35:38.474ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51632024-11-01T22:35:38.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51642024-11-01T22:35:38.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51652024-11-01T22:35:38.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51662024-11-01T22:35:38.478ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
51672024-11-01T22:35:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51682024-11-01T22:35:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51692024-11-01T22:35:38.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51702024-11-01T22:35:38.481ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = e13e7e47-f477-4fe8-bdb1-92ef74855e4f
51712024-11-01T22:35:38.481ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 3cd78d43-b1de-41bd-b849-a2b92782ad72
51722024-11-01T22:35:38.481ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 67fbbfa2-402d-44d5-9ab8-19f72cc93cee
51732024-11-01T22:35:38.481ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 3cd78d43-b1de-41bd-b849-a2b92782ad72
51742024-11-01T22:35:38.481ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 67fbbfa2-402d-44d5-9ab8-19f72cc93cee
51752024-11-01T22:35:38.481ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = e13e7e47-f477-4fe8-bdb1-92ef74855e4f
51762024-11-01T22:35:38.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51772024-11-01T22:35:38.481ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51782024-11-01T22:35:38.481ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51792024-11-01T22:35:38.481ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 42.300151ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51802024-11-01T22:35:38.483ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 44.348597ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
51812024-11-01T22:35:38.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51822024-11-01T22:35:38.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51832024-11-01T22:35:38.487ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
51842024-11-01T22:35:38.487ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.459508ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
51852024-11-01T22:35:38.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51862024-11-01T22:35:38.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
51872024-11-01T22:35:38.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51882024-11-01T22:35:38.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51892024-11-01T22:35:38.491ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51902024-11-01T22:35:38.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51912024-11-01T22:35:38.494ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51922024-11-01T22:35:38.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51932024-11-01T22:35:38.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51942024-11-01T22:35:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51952024-11-01T22:35:38.502ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51962024-11-01T22:35:38.502ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.834817ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51972024-11-01T22:35:38.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51982024-11-01T22:35:38.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51992024-11-01T22:35:38.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52002024-11-01T22:35:38.504ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52012024-11-01T22:35:38.504ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52022024-11-01T22:35:38.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52032024-11-01T22:35:38.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52042024-11-01T22:35:38.506ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52052024-11-01T22:35:38.506ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52062024-11-01T22:35:38.506ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52072024-11-01T22:35:38.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52082024-11-01T22:35:38.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52092024-11-01T22:35:38.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
52102024-11-01T22:35:38.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52112024-11-01T22:35:38.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52122024-11-01T22:35:38.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52132024-11-01T22:35:38.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52142024-11-01T22:35:38.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52152024-11-01T22:35:38.512ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52162024-11-01T22:35:38.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52172024-11-01T22:35:38.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52182024-11-01T22:35:38.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52192024-11-01T22:35:38.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52202024-11-01T22:35:38.514ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52212024-11-01T22:35:38.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52222024-11-01T22:35:38.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52232024-11-01T22:35:38.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52242024-11-01T22:35:38.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52252024-11-01T22:35:38.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52262024-11-01T22:35:38.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52272024-11-01T22:35:38.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52282024-11-01T22:35:38.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52292024-11-01T22:35:38.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52302024-11-01T22:35:38.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.992273ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52312024-11-01T22:35:38.522ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52322024-11-01T22:35:38.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52332024-11-01T22:35:38.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52342024-11-01T22:35:38.522ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 2fdb78ca-5017-43b2-9ee5-ea8846e04882 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
52352024-11-01T22:35:38.522ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52362024-11-01T22:35:38.523ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52372024-11-01T22:35:38.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
52382024-11-01T22:35:38.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52392024-11-01T22:35:38.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52402024-11-01T22:35:38.525ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52412024-11-01T22:35:38.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52422024-11-01T22:35:38.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52432024-11-01T22:35:38.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52442024-11-01T22:35:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52452024-11-01T22:35:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52462024-11-01T22:35:38.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52472024-11-01T22:35:38.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52482024-11-01T22:35:38.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52492024-11-01T22:35:38.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52502024-11-01T22:35:38.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52512024-11-01T22:35:38.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52522024-11-01T22:35:38.531ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52532024-11-01T22:35:38.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52542024-11-01T22:35:38.532ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(511f349d-08c2-4524-a15c-cbf80c6399cc, 0), (c615b805-18f1-452f-a5af-bbfaacaae3ef, 0), (a160f501-189e-490d-a526-09fd9176e698, 0)]
52552024-11-01T22:35:38.532ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 561497249 } })
52562024-11-01T22:35:38.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52572024-11-01T22:35:38.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
52582024-11-01T22:35:38.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52592024-11-01T22:35:38.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52602024-11-01T22:35:38.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52612024-11-01T22:35:38.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52622024-11-01T22:35:38.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52632024-11-01T22:35:38.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52642024-11-01T22:35:38.552ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52652024-11-01T22:35:38.552ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52662024-11-01T22:35:38.552ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52672024-11-01T22:35:38.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52682024-11-01T22:35:38.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52692024-11-01T22:35:38.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52702024-11-01T22:35:38.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52712024-11-01T22:35:38.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52722024-11-01T22:35:38.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52732024-11-01T22:35:38.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52742024-11-01T22:35:38.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52752024-11-01T22:35:38.563ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52762024-11-01T22:35:38.563ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52772024-11-01T22:35:38.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52782024-11-01T22:35:38.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52792024-11-01T22:35:38.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802024-11-01T22:35:38.567ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52812024-11-01T22:35:38.567ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52822024-11-01T22:35:38.567ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52832024-11-01T22:35:38.567ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.210134ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52842024-11-01T22:35:38.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52852024-11-01T22:35:38.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52862024-11-01T22:35:38.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52872024-11-01T22:35:38.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52882024-11-01T22:35:38.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52892024-11-01T22:35:38.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52902024-11-01T22:35:38.574ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52912024-11-01T22:35:38.574ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52922024-11-01T22:35:38.574ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
52932024-11-01T22:35:38.574ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 134.891734ms iteration = 12 status = {"generation":1}
52942024-11-01T22:35:38.575ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52952024-11-01T22:35:38.575ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52962024-11-01T22:35:38.575ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.628638ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52972024-11-01T22:35:38.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.840522ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52982024-11-01T22:35:38.593ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52992024-11-01T22:35:38.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53002024-11-01T22:35:38.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
53012024-11-01T22:35:38.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53022024-11-01T22:35:38.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53032024-11-01T22:35:38.602ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 163.352221ms iteration = 21 status = 0
53042024-11-01T22:35:38.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53052024-11-01T22:35:38.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53062024-11-01T22:35:38.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53072024-11-01T22:35:38.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53082024-11-01T22:35:38.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53092024-11-01T22:35:38.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53102024-11-01T22:35:38.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53112024-11-01T22:35:38.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53122024-11-01T22:35:38.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53132024-11-01T22:35:38.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53142024-11-01T22:35:38.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53152024-11-01T22:35:38.629ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
53162024-11-01T22:35:38.629ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 190.012473ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53172024-11-01T22:35:38.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53182024-11-01T22:35:38.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53192024-11-01T22:35:38.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53202024-11-01T22:35:38.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53212024-11-01T22:35:38.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53222024-11-01T22:35:38.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
53232024-11-01T22:35:38.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53242024-11-01T22:35:38.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53252024-11-01T22:35:38.636ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53262024-11-01T22:35:38.636ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
53272024-11-01T22:35:38.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53282024-11-01T22:35:38.636ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53292024-11-01T22:35:38.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53302024-11-01T22:35:38.638ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53312024-11-01T22:35:38.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53322024-11-01T22:35:38.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53332024-11-01T22:35:38.651ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53342024-11-01T22:35:38.651ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53352024-11-01T22:35:38.652ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cfca88b-3102-4a1f-a859-5298dfdf7e2f", "content-length": "26", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53362024-11-01T22:35:38.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53372024-11-01T22:35:38.653ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53382024-11-01T22:35:38.669ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53392024-11-01T22:35:38.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 230.545442ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53402024-11-01T22:35:38.709ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 269.923ms iteration = 24 status = {"physical_disks_added":0}
53412024-11-01T22:35:38.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53422024-11-01T22:35:38.717ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53432024-11-01T22:35:38.718ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eae1894c-0734-4199-99c1-1fee41158cd9", "content-length": "26", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53442024-11-01T22:35:38.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53452024-11-01T22:35:38.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53462024-11-01T22:35:38.754ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
53472024-11-01T22:35:38.754ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
53482024-11-01T22:35:38.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
53492024-11-01T22:35:38.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b4537e-7033-4c6e-b4ff-a5573fec2bad", "content-length": "476", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53502024-11-01T22:35:38.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
53512024-11-01T22:35:38.755ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "578e2661-f50d-408f-81d9-57691f3b507e", "content-length": "734", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53522024-11-01T22:35:38.755ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
53532024-11-01T22:35:38.755ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d26169b-517d-45ed-b8e0-4815b1a19b65", "content-length": "111", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53542024-11-01T22:35:38.755ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
53552024-11-01T22:35:38.755ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f139c36-b4ee-4a05-a55e-8425bfc926c4", "content-length": "111", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53562024-11-01T22:35:38.755ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
53572024-11-01T22:35:38.756ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "99adb506-a2d5-411e-87e7-983f51fb47e9", "content-length": "167", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53582024-11-01T22:35:38.756ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
53592024-11-01T22:35:38.756ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "53a9f1e3-36e5-4502-80ad-97db4e7f349e", "content-length": "167", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53602024-11-01T22:35:38.756ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
53612024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb650490-194b-43d6-9611-98168ac25a2b", "content-length": "175", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53622024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
53632024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "18030e4e-30a0-46c3-aab0-7857952f28c4", "content-length": "175", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53642024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
53652024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec00eec3-07d5-42b7-9e56-914a5edf6d99", "content-length": "702", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53662024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
53672024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b8b0516-dd4b-4fd8-82af-100c018b0f74", "content-length": "727", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53682024-11-01T22:35:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
53692024-11-01T22:35:38.758ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "75a5faea-703b-4f77-8e43-3423a998fc1d", "content-length": "729", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53702024-11-01T22:35:38.758ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
53712024-11-01T22:35:38.758ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2111ff2-2402-43d0-b3f3-f4b9be6a3b7c", "content-length": "728", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53722024-11-01T22:35:38.758ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
53732024-11-01T22:35:38.758ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a099771-fff0-4bf1-a870-a441078c122e", "content-length": "722", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53742024-11-01T22:35:38.758ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
53752024-11-01T22:35:38.759ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffbe4c16-6447-4a63-aae4-6ed89e09cfe4", "content-length": "109", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53762024-11-01T22:35:38.759ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
53772024-11-01T22:35:38.759ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "181e6cda-b227-418d-a6b1-eaaa0270bc5a", "content-length": "109", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53782024-11-01T22:35:38.759ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
53792024-11-01T22:35:38.759ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d361f610-af8f-4269-bcae-0b77cbbd4295", "content-length": "169", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53802024-11-01T22:35:38.759ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
53812024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "24afe201-fb97-4fec-8f53-7d02f7075293", "content-length": "169", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53822024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
53832024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "04fa5bff-02a6-495b-82af-30c42218d027", "content-length": "178", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53842024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
53852024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f0a5b89-0585-4b51-b762-9741896b6ee3", "content-length": "178", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53862024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
53872024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "704b5d33-1a34-4643-b634-8c6e492d6add", "content-length": "702", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53882024-11-01T22:35:38.760ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
53892024-11-01T22:35:38.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "90ce8bb6-352c-42eb-aa10-7fdb59098cd1", "content-length": "727", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53902024-11-01T22:35:38.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
53912024-11-01T22:35:38.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fef8a734-512e-4dba-885b-6ca8913cf1e9", "content-length": "729", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53922024-11-01T22:35:38.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
53932024-11-01T22:35:38.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "16b10150-7199-4727-a065-26f86f3977c6", "content-length": "728", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53942024-11-01T22:35:38.761ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53952024-11-01T22:35:38.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53962024-11-01T22:35:38.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
53972024-11-01T22:35:38.762ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53982024-11-01T22:35:38.762ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d34c6631-7ccb-4578-9b97-fcae9c1abf2d", "content-length": "26", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
53992024-11-01T22:35:38.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54002024-11-01T22:35:38.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
54012024-11-01T22:35:38.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = e9461ce8-b312-47c8-adf2-81251d072a3d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54022024-11-01T22:35:38.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = e9461ce8-b312-47c8-adf2-81251d072a3d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54032024-11-01T22:35:38.834ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54042024-11-01T22:35:38.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "add809ad-9390-483b-afe0-a4b2b1d12200", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54052024-11-01T22:35:38.834ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54062024-11-01T22:35:38.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5851eab0-73f8-42b2-b179-e9a6882967b6", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54072024-11-01T22:35:38.836ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54082024-11-01T22:35:38.838ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54092024-11-01T22:35:38.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 399.036091ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54102024-11-01T22:35:38.857ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 417.682052ms iteration = 21 status = {}
54112024-11-01T22:35:38.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
54122024-11-01T22:35:39.004ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54132024-11-01T22:35:39.004ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54142024-11-01T22:35:39.004ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1b02ac7-0d2f-419b-9953-0b304df2e6fc", "content-length": "372", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
54152024-11-01T22:35:39.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54162024-11-01T22:35:39.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54172024-11-01T22:35:39.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54182024-11-01T22:35:39.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54192024-11-01T22:35:39.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54202024-11-01T22:35:39.008ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54212024-11-01T22:35:39.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = e9461ce8-b312-47c8-adf2-81251d072a3d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
54222024-11-01T22:35:39.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
54232024-11-01T22:35:39.012ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54242024-11-01T22:35:39.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54252024-11-01T22:35:39.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54262024-11-01T22:35:39.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54272024-11-01T22:35:39.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54282024-11-01T22:35:39.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54292024-11-01T22:35:39.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54302024-11-01T22:35:39.045ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54312024-11-01T22:35:39.045ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "45aec877-a779-4687-b4a0-c93806c7dc23", "content-length": "1", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
54322024-11-01T22:35:39.047ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54332024-11-01T22:35:39.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54342024-11-01T22:35:39.073ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54352024-11-01T22:35:39.073ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54362024-11-01T22:35:39.074ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fc3c33be-290e-49a5-a0a5-e1718d3e1638", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
54372024-11-01T22:35:39.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54382024-11-01T22:35:39.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54392024-11-01T22:35:39.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54402024-11-01T22:35:39.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54412024-11-01T22:35:39.165ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
54422024-11-01T22:35:39.165ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3653352d-cec6-4352-87cc-311a32e5c3e3", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
54432024-11-01T22:35:39.165ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
54442024-11-01T22:35:39.167ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "45ccfaa5-4064-4ca9-830e-8be9007e28ff", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
54452024-11-01T22:35:39.167ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
54462024-11-01T22:35:39.168ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "59e1c605-9f76-4c50-8020-a5428bf8200a", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
54472024-11-01T22:35:39.168ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
54482024-11-01T22:35:39.170ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
54492024-11-01T22:35:39.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 730.983953ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54502024-11-01T22:35:39.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54512024-11-01T22:35:39.175ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54522024-11-01T22:35:39.176ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
54532024-11-01T22:35:39.176ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54542024-11-01T22:35:39.176ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
54552024-11-01T22:35:39.176ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 736.852206ms iteration = 12 status = {"generation":2}
54562024-11-01T22:35:39.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54572024-11-01T22:35:39.177ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 738.723442ms iteration = 21 status = null
54582024-11-01T22:35:39.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
54592024-11-01T22:35:39.178ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54602024-11-01T22:35:39.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54612024-11-01T22:35:39.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54622024-11-01T22:35:39.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54632024-11-01T22:35:39.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
54642024-11-01T22:35:39.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54652024-11-01T22:35:39.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54662024-11-01T22:35:39.183ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
54672024-11-01T22:35:39.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54682024-11-01T22:35:39.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54692024-11-01T22:35:39.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54702024-11-01T22:35:39.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54712024-11-01T22:35:39.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54722024-11-01T22:35:39.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54732024-11-01T22:35:39.188ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54742024-11-01T22:35:39.188ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54752024-11-01T22:35:39.193ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54762024-11-01T22:35:39.193ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7799007-d6f8-4a9b-8c0a-f7575ccda6f3", "content-length": "134", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
54772024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54782024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
54792024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54802024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54812024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54822024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54832024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54842024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54852024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54862024-11-01T22:35:39.193ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54872024-11-01T22:35:39.194ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
54882024-11-01T22:35:39.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54892024-11-01T22:35:39.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54902024-11-01T22:35:39.216ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
54912024-11-01T22:35:39.216ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
54922024-11-01T22:35:39.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54932024-11-01T22:35:39.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54942024-11-01T22:35:39.219ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54952024-11-01T22:35:39.219ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8f5c972-e7f6-4aba-8dae-fbff5ecc731a", "content-length": "2", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
54962024-11-01T22:35:39.219ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54972024-11-01T22:35:39.219ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2c53368-7c27-479d-98e6-df3d302bfc51", "content-length": "52", "date": "Fri, 01 Nov 2024 22:35:38 GMT"} })
54982024-11-01T22:35:39.219ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
54992024-11-01T22:35:39.219ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55002024-11-01T22:35:39.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55012024-11-01T22:35:39.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55022024-11-01T22:35:39.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55032024-11-01T22:35:39.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55042024-11-01T22:35:39.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55052024-11-01T22:35:39.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55062024-11-01T22:35:39.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55072024-11-01T22:35:39.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55082024-11-01T22:35:39.228ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55092024-11-01T22:35:39.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55102024-11-01T22:35:39.230ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55112024-11-01T22:35:39.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
55122024-11-01T22:35:39.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55132024-11-01T22:35:39.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55142024-11-01T22:35:39.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55152024-11-01T22:35:39.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55162024-11-01T22:35:39.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55172024-11-01T22:35:39.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55182024-11-01T22:35:39.238ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55192024-11-01T22:35:39.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
55202024-11-01T22:35:39.242ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55212024-11-01T22:35:39.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55222024-11-01T22:35:39.248ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
55232024-11-01T22:35:39.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55242024-11-01T22:35:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55252024-11-01T22:35:39.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55262024-11-01T22:35:39.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
55272024-11-01T22:35:39.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55282024-11-01T22:35:39.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55292024-11-01T22:35:39.253ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
55302024-11-01T22:35:39.253ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1b96440c-5ef2-4486-8a5f-67d171ad41c4, kind: Service { id: 16f8af4d-7626-4144-90ca-74043fcc6867 }, name: Name("external-dns-16f8af4d-7626-4144-90ca-74043fcc6867"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 718a773b-b30c-45dc-bb3f-40ad11f43afd, kind: Service { id: 52d11306-028a-4d00-8d4d-07c571263f67 }, name: Name("external-dns-52d11306-028a-4d00-8d4d-07c571263f67"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1a6b6e0d-bb27-42bd-8786-02465ea03d85, kind: Service { id: 9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf }, name: Name("nexus-9d6a01b6-9b62-40e0-a28f-dc19cc5a69bf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c67b1a0-3a52-4d8b-922d-3ce04f26ca62, kind: Service { id: b44c0c8a-0647-4c99-9bb4-b2362d0eab3a }, name: Name("nexus-b44c0c8a-0647-4c99-9bb4-b2362d0eab3a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6fa01def-c151-4442-81ab-911015d2239e, kind: Service { id: 7e5351f7-5c9c-48ef-96e0-d88878eeb116 }, name: Name("nexus-7e5351f7-5c9c-48ef-96e0-d88878eeb116"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 153])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
55312024-11-01T22:35:39.253ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
55322024-11-01T22:35:39.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 07af6769-6555-40ef-892b-5248ed255f10 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55332024-11-01T22:35:39.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 07af6769-6555-40ef-892b-5248ed255f10 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55342024-11-01T22:35:39.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2c815e8f-ce99-4a54-bae4-87e7ea542c83", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} })
55352024-11-01T22:35:39.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3c109d1-fa23-4b1c-a1d3-350ff6191a4c", "content-length": "691", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} })
55362024-11-01T22:35:39.255ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55372024-11-01T22:35:39.255ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55382024-11-01T22:35:39.255ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55392024-11-01T22:35:39.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 07af6769-6555-40ef-892b-5248ed255f10 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55402024-11-01T22:35:39.256ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 817.393639ms iteration = 22 status = {}
55412024-11-01T22:35:39.257ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 818.463197ms iteration = 21 status = {}
55422024-11-01T22:35:39.306ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8559b5a7-3301-45c6-8f36-6213ed147b79, time_created: 2024-11-01T22:26:05.243260Z, time_modified: 2024-11-01T22:26:05.243260Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
55432024-11-01T22:35:39.306ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
55442024-11-01T22:35:39.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55452024-11-01T22:35:39.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55462024-11-01T22:35:39.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55472024-11-01T22:35:39.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55482024-11-01T22:35:39.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55492024-11-01T22:35:39.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
55502024-11-01T22:35:39.344ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
55512024-11-01T22:35:39.378ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "400cfd76-4139-4bbc-9446-2ce17844e1d9", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} })
55522024-11-01T22:35:39.379ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
55532024-11-01T22:35:39.379ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 940.335543ms
55542024-11-01T22:35:39.379ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 940.345823ms iteration = 3 status = {}
55552024-11-01T22:35:39.404ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8d89f990-1483-4ab2-9150-15b48c9ef97a", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} })
55562024-11-01T22:35:39.404ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
55572024-11-01T22:35:39.404ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55582024-11-01T22:35:39.416ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "032880da-5557-4448-8cba-846e9da70e46", "content-length": "682", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} })
55592024-11-01T22:35:39.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55602024-11-01T22:35:39.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55612024-11-01T22:35:39.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55622024-11-01T22:35:39.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55632024-11-01T22:35:39.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55642024-11-01T22:35:39.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55652024-11-01T22:35:39.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55662024-11-01T22:35:39.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55672024-11-01T22:35:39.432ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 993.167314ms iteration = 21 status = {}
55682024-11-01T22:35:39.596ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "e80b9384-e5fb-4add-a098-64e9b5cdf872", "content-length": "29195", "date": "Fri, 01 Nov 2024 22:35:39 GMT"} })
55692024-11-01T22:35:39.598ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
55702024-11-01T22:35:39.600ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
55712024-11-01T22:35:39.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
55722024-11-01T22:35:39.602ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55732024-11-01T22:35:39.604ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
55742024-11-01T22:35:39.604ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
55752024-11-01T22:35:39.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
55762024-11-01T22:35:39.773ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = c8f6869d-6ccb-4944-a82a-ea1010116dcd file = nexus/db-queries/src/db/datastore/inventory.rs:1000
55772024-11-01T22:35:39.773ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = c8f6869d-6ccb-4944-a82a-ea1010116dcd time_started = 2024-11-01 22:35:38.754373 UTC
55782024-11-01T22:35:39.773ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.334242195s iteration = 4 status = {"collection_id":"c8f6869d-6ccb-4944-a82a-ea1010116dcd","time_done":"2024-11-01 22:35:39.598951 UTC","time_started":"2024-11-01 22:35:38.754373 UTC"}
55792024-11-01T22:35:39.773ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
55802024-11-01T22:35:39.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55812024-11-01T22:35:39.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55822024-11-01T22:35:39.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55832024-11-01T22:35:39.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55842024-11-01T22:35:39.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55852024-11-01T22:35:39.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55862024-11-01T22:35:39.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55872024-11-01T22:35:39.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55882024-11-01T22:35:39.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55892024-11-01T22:35:39.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55902024-11-01T22:35:39.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55912024-11-01T22:35:39.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55922024-11-01T22:35:39.829ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 55.34582ms iteration = 25 status = {"physical_disks_added":0}
55932024-11-01T22:35:40.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7d1d3a8d-b10a-4af6-af6d-37c698026fa2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55942024-11-01T22:35:40.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7d1d3a8d-b10a-4af6-af6d-37c698026fa2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55952024-11-01T22:35:40.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7d1d3a8d-b10a-4af6-af6d-37c698026fa2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55962024-11-01T22:35:41.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc9ad1dd-e1fe-4a4d-916b-369e7c6e67b9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55972024-11-01T22:35:41.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc9ad1dd-e1fe-4a4d-916b-369e7c6e67b9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55982024-11-01T22:35:41.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc9ad1dd-e1fe-4a4d-916b-369e7c6e67b9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
55992024-11-01T22:35:42.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12e6eb44-5dee-44a4-924e-93de42d4b256 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56002024-11-01T22:35:42.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12e6eb44-5dee-44a4-924e-93de42d4b256 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56012024-11-01T22:35:42.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 12e6eb44-5dee-44a4-924e-93de42d4b256 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56022024-11-01T22:35:43.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1361 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 1e67ba02-d1ff-4667-971f-8678f4e8dc21 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
56032024-11-01T22:35:43.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fb595435-1f38-499b-8a2a-a51f9468e6c4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56042024-11-01T22:35:43.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fb595435-1f38-499b-8a2a-a51f9468e6c4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56052024-11-01T22:35:43.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fb595435-1f38-499b-8a2a-a51f9468e6c4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56062024-11-01T22:35:44.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1a545928-9ce5-4765-b3bf-048cc7ad430d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56072024-11-01T22:35:44.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1a545928-9ce5-4765-b3bf-048cc7ad430d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56082024-11-01T22:35:44.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1a545928-9ce5-4765-b3bf-048cc7ad430d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56092024-11-01T22:35:45.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c4cb2872-c8db-4512-bede-1320a85f797a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56102024-11-01T22:35:45.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c4cb2872-c8db-4512-bede-1320a85f797a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56112024-11-01T22:35:45.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c4cb2872-c8db-4512-bede-1320a85f797a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56122024-11-01T22:35:46.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 811636ac-af60-4941-8d58-2f4a3a7f1cf5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56132024-11-01T22:35:46.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 811636ac-af60-4941-8d58-2f4a3a7f1cf5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56142024-11-01T22:35:46.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 811636ac-af60-4941-8d58-2f4a3a7f1cf5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56152024-11-01T22:35:47.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba049c15-f7ae-4c9f-bd1c-1c3df457a7bb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56162024-11-01T22:35:47.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba049c15-f7ae-4c9f-bd1c-1c3df457a7bb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56172024-11-01T22:35:47.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ba049c15-f7ae-4c9f-bd1c-1c3df457a7bb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56182024-11-01T22:35:48.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
56192024-11-01T22:35:48.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56202024-11-01T22:35:48.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
56212024-11-01T22:35:48.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56222024-11-01T22:35:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56232024-11-01T22:35:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56242024-11-01T22:35:48.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56252024-11-01T22:35:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56262024-11-01T22:35:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56272024-11-01T22:35:48.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.759179ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56282024-11-01T22:35:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56292024-11-01T22:35:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56302024-11-01T22:35:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56312024-11-01T22:35:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56322024-11-01T22:35:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56332024-11-01T22:35:48.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56342024-11-01T22:35:48.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
56352024-11-01T22:35:48.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56362024-11-01T22:35:48.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56372024-11-01T22:35:48.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
56382024-11-01T22:35:48.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.402178ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
56392024-11-01T22:35:48.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a9179cdb-ff0b-48e8-a5d0-20aae2051566 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56402024-11-01T22:35:48.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a9179cdb-ff0b-48e8-a5d0-20aae2051566 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56412024-11-01T22:35:48.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a9179cdb-ff0b-48e8-a5d0-20aae2051566 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56422024-11-01T22:35:48.633ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52159
56432024-11-01T22:35:48.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52159 req_id = 40ad796a-67ed-4f2a-813b-39ddb54c747c roles = RoleSet { roles: {} } uri = /metrics/producers
56442024-11-01T22:35:48.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52159 req_id = 40ad796a-67ed-4f2a-813b-39ddb54c747c resource = Database result = Ok(()) uri = /metrics/producers
56452024-11-01T22:35:48.672ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = eb6325c7-d1c1-4d78-89ec-4210cb4d49a2
56462024-11-01T22:35:48.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36341 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52159 req_id = 40ad796a-67ed-4f2a-813b-39ddb54c747c response_code = 201 uri = /metrics/producers
56472024-11-01T22:35:49.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d47d1fda-97a9-4d86-b20f-0e23393cba84 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56482024-11-01T22:35:49.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d47d1fda-97a9-4d86-b20f-0e23393cba84 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56492024-11-01T22:35:49.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d47d1fda-97a9-4d86-b20f-0e23393cba84 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56502024-11-01T22:35:50.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68cdb30d-c197-4922-bb65-548c7e3ae6b6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56512024-11-01T22:35:50.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68cdb30d-c197-4922-bb65-548c7e3ae6b6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56522024-11-01T22:35:50.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 68cdb30d-c197-4922-bb65-548c7e3ae6b6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56532024-11-01T22:35:50.698ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46857
56542024-11-01T22:35:50.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46857 req_id = d0cc9302-4d0b-4811-9b01-966510c44184 roles = RoleSet { roles: {} } uri = /metrics/producers
56552024-11-01T22:35:50.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46857 req_id = d0cc9302-4d0b-4811-9b01-966510c44184 resource = Database result = Ok(()) uri = /metrics/producers
56562024-11-01T22:35:50.736ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 0c64e418-1894-441d-86b0-7394a1124e4a
56572024-11-01T22:35:50.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37307 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46857 req_id = d0cc9302-4d0b-4811-9b01-966510c44184 response_code = 201 uri = /metrics/producers
56582024-11-01T22:35:51.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0cebf958-60e7-47aa-8cdc-573f65162200 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56592024-11-01T22:35:51.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0cebf958-60e7-47aa-8cdc-573f65162200 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56602024-11-01T22:35:51.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0cebf958-60e7-47aa-8cdc-573f65162200 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56612024-11-01T22:35:52.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = da52a6ee-dd65-44b3-90c9-071dadaaca81 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56622024-11-01T22:35:52.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = da52a6ee-dd65-44b3-90c9-071dadaaca81 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56632024-11-01T22:35:52.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = da52a6ee-dd65-44b3-90c9-071dadaaca81 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56642024-11-01T22:35:53.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58ffe696-72b4-45aa-a8b7-f708702dcb45 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56652024-11-01T22:35:53.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58ffe696-72b4-45aa-a8b7-f708702dcb45 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56662024-11-01T22:35:53.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58ffe696-72b4-45aa-a8b7-f708702dcb45 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56672024-11-01T22:35:54.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 45a9d992-e592-4982-88d0-b5db48372f9f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56682024-11-01T22:35:54.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 45a9d992-e592-4982-88d0-b5db48372f9f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56692024-11-01T22:35:54.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 45a9d992-e592-4982-88d0-b5db48372f9f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56702024-11-01T22:35:55.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 23b9b234-b474-4af4-a045-0a0c72112ec3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56712024-11-01T22:35:55.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 23b9b234-b474-4af4-a045-0a0c72112ec3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56722024-11-01T22:35:55.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 23b9b234-b474-4af4-a045-0a0c72112ec3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56732024-11-01T22:35:56.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e6c258e-ccc0-411d-9777-e93ac79a5fee roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56742024-11-01T22:35:56.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e6c258e-ccc0-411d-9777-e93ac79a5fee resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56752024-11-01T22:35:56.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e6c258e-ccc0-411d-9777-e93ac79a5fee response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56762024-11-01T22:35:57.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4ad08494-50e5-4587-ae0b-614184848139 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56772024-11-01T22:35:57.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4ad08494-50e5-4587-ae0b-614184848139 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56782024-11-01T22:35:57.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4ad08494-50e5-4587-ae0b-614184848139 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
56792024-11-01T22:35:58.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1397 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = a3055c17-7539-4a7c-8856-42313d204ff8 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
56802024-11-01T22:35:58.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
56812024-11-01T22:35:58.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
56822024-11-01T22:35:58.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56832024-11-01T22:35:58.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56842024-11-01T22:35:58.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56852024-11-01T22:35:58.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56862024-11-01T22:35:58.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56872024-11-01T22:35:58.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56882024-11-01T22:35:58.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56892024-11-01T22:35:58.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.708599ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56902024-11-01T22:35:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56912024-11-01T22:35:58.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56922024-11-01T22:35:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56932024-11-01T22:35:58.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56942024-11-01T22:35:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56952024-11-01T22:35:58.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56962024-11-01T22:35:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
56972024-11-01T22:35:58.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56982024-11-01T22:35:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56992024-11-01T22:35:58.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
57002024-11-01T22:35:58.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.282794ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
57012024-11-01T22:35:58.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b54df77e-de5c-40f6-8ab8-00558f9481cf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57022024-11-01T22:35:58.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b54df77e-de5c-40f6-8ab8-00558f9481cf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57032024-11-01T22:35:58.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b54df77e-de5c-40f6-8ab8-00558f9481cf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57042024-11-01T22:35:59.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 01e50b70-0af7-4249-b538-7ff12f06c245 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57052024-11-01T22:35:59.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 01e50b70-0af7-4249-b538-7ff12f06c245 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57062024-11-01T22:35:59.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 01e50b70-0af7-4249-b538-7ff12f06c245 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57072024-11-01T22:36:00.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f4e5ae-2019-4899-be33-9d77cfab32dd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57082024-11-01T22:36:00.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f4e5ae-2019-4899-be33-9d77cfab32dd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57092024-11-01T22:36:00.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c1f4e5ae-2019-4899-be33-9d77cfab32dd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57102024-11-01T22:36:01.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 211cd872-34b6-4989-ac73-3339e31b6405 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57112024-11-01T22:36:01.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 211cd872-34b6-4989-ac73-3339e31b6405 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57122024-11-01T22:36:01.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 211cd872-34b6-4989-ac73-3339e31b6405 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57132024-11-01T22:36:02.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1b9a1181-894c-45e5-8021-2e2a31fff627 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57142024-11-01T22:36:02.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1b9a1181-894c-45e5-8021-2e2a31fff627 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57152024-11-01T22:36:02.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1b9a1181-894c-45e5-8021-2e2a31fff627 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57162024-11-01T22:36:03.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bf79e671-c22d-4026-8da3-ef8603142c55 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57172024-11-01T22:36:03.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bf79e671-c22d-4026-8da3-ef8603142c55 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57182024-11-01T22:36:03.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bf79e671-c22d-4026-8da3-ef8603142c55 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57192024-11-01T22:36:04.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c4e28c99-f80e-4c99-bde9-b99465946f42 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57202024-11-01T22:36:04.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c4e28c99-f80e-4c99-bde9-b99465946f42 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57212024-11-01T22:36:04.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c4e28c99-f80e-4c99-bde9-b99465946f42 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57222024-11-01T22:36:05.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b30fb70-02cd-4ac3-ac82-2f5fd575b127 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57232024-11-01T22:36:05.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b30fb70-02cd-4ac3-ac82-2f5fd575b127 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57242024-11-01T22:36:05.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b30fb70-02cd-4ac3-ac82-2f5fd575b127 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57252024-11-01T22:36:06.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a2e94966-47e7-44b9-a61f-4bbad79caffd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57262024-11-01T22:36:06.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a2e94966-47e7-44b9-a61f-4bbad79caffd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57272024-11-01T22:36:06.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a2e94966-47e7-44b9-a61f-4bbad79caffd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57282024-11-01T22:36:07.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 76b95316-0bd1-4bec-9e14-e8a515f6b220 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57292024-11-01T22:36:07.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 76b95316-0bd1-4bec-9e14-e8a515f6b220 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57302024-11-01T22:36:07.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 76b95316-0bd1-4bec-9e14-e8a515f6b220 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
57312024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
57322024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 29.82\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
57332024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
57342024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
57352024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57362024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
57372024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57382024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
57392024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57402024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57412024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
57422024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.06\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
57432024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
57442024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
57452024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57462024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
57472024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
57482024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57492024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57502024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
57512024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57522024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
57532024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57542024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57552024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
57562024-11-01T22:36:08.440ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57572024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57582024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
57592024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.71\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
57602024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
57612024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
57622024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.76\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
57632024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57642024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
57652024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57662024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57672024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57682024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57692024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57702024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57712024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57722024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57732024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57742024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57752024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57762024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57772024-11-01T22:36:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57782024-11-01T22:36:08.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 471345664 } })
57792024-11-01T22:36:08.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
57802024-11-01T22:36:08.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57812024-11-01T22:36:08.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-11-01T22:36:08.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.362733ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57832024-11-01T22:36:08.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57842024-11-01T22:36:08.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57852024-11-01T22:36:08.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57862024-11-01T22:36:08.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57872024-11-01T22:36:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57882024-11-01T22:36:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57892024-11-01T22:36:08.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57902024-11-01T22:36:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57912024-11-01T22:36:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57922024-11-01T22:36:08.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57932024-11-01T22:36:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57942024-11-01T22:36:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57952024-11-01T22:36:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57962024-11-01T22:36:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57972024-11-01T22:36:08.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57982024-11-01T22:36:08.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 477530681 } })
57992024-11-01T22:36:08.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58002024-11-01T22:36:08.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
58012024-11-01T22:36:08.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58022024-11-01T22:36:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58032024-11-01T22:36:08.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58042024-11-01T22:36:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58052024-11-01T22:36:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58062024-11-01T22:36:08.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58072024-11-01T22:36:08.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58082024-11-01T22:36:08.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58092024-11-01T22:36:08.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58102024-11-01T22:36:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58112024-11-01T22:36:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58122024-11-01T22:36:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58132024-11-01T22:36:08.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58142024-11-01T22:36:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58152024-11-01T22:36:08.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58162024-11-01T22:36:08.454ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 483265695 } })
58172024-11-01T22:36:08.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58182024-11-01T22:36:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58192024-11-01T22:36:08.455ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
58202024-11-01T22:36:08.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58212024-11-01T22:36:08.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58222024-11-01T22:36:08.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58232024-11-01T22:36:08.481ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58242024-11-01T22:36:08.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58252024-11-01T22:36:08.482ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58262024-11-01T22:36:08.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58272024-11-01T22:36:08.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.182098ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58282024-11-01T22:36:08.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58292024-11-01T22:36:08.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58302024-11-01T22:36:08.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58312024-11-01T22:36:08.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58322024-11-01T22:36:08.491ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58332024-11-01T22:36:08.491ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.003728ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58342024-11-01T22:36:08.491ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58352024-11-01T22:36:08.491ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58362024-11-01T22:36:08.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58372024-11-01T22:36:08.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58382024-11-01T22:36:08.496ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58392024-11-01T22:36:08.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58402024-11-01T22:36:08.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58412024-11-01T22:36:08.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58422024-11-01T22:36:08.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58432024-11-01T22:36:08.500ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58442024-11-01T22:36:08.500ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "550e9092-e4df-4a70-b5d6-f221e37c66cd", "content-length": "26", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
58452024-11-01T22:36:08.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58462024-11-01T22:36:08.501ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58472024-11-01T22:36:08.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58482024-11-01T22:36:08.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
58492024-11-01T22:36:08.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58502024-11-01T22:36:08.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58512024-11-01T22:36:08.507ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 67.208551ms iteration = 26 status = {"physical_disks_added":0}
58522024-11-01T22:36:08.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.453416ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58532024-11-01T22:36:08.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
58542024-11-01T22:36:08.515ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58552024-11-01T22:36:08.516ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6053b44-0e15-4cb8-8e01-a8ba579fe7f6", "content-length": "26", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
58562024-11-01T22:36:08.516ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58572024-11-01T22:36:08.518ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
58582024-11-01T22:36:08.519ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
58592024-11-01T22:36:08.519ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.451083ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
58602024-11-01T22:36:08.521ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58612024-11-01T22:36:08.521ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58622024-11-01T22:36:08.521ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.406818ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58632024-11-01T22:36:08.521ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58642024-11-01T22:36:08.521ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58652024-11-01T22:36:08.522ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1043338f-c016-4aa1-83a6-ea183a2451a3", "content-length": "26", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
58662024-11-01T22:36:08.522ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58672024-11-01T22:36:08.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58682024-11-01T22:36:08.523ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58692024-11-01T22:36:08.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
58702024-11-01T22:36:08.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58712024-11-01T22:36:08.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58722024-11-01T22:36:08.528ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.13983ms iteration = 22 status = 0
58732024-11-01T22:36:08.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58742024-11-01T22:36:08.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58752024-11-01T22:36:08.598ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58762024-11-01T22:36:08.598ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0747c670-cd0b-4545-aab6-29840b068caf", "content-length": "1", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
58772024-11-01T22:36:08.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58782024-11-01T22:36:08.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58792024-11-01T22:36:08.603ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 163.818035ms iteration = 22 status = null
58802024-11-01T22:36:08.619ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58812024-11-01T22:36:08.619ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58822024-11-01T22:36:08.620ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c180c5a-b89e-4043-9000-4e031019de98", "content-length": "372", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
58832024-11-01T22:36:08.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58842024-11-01T22:36:08.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58852024-11-01T22:36:08.621ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 181.551839ms iteration = 22 status = {}
58862024-11-01T22:36:08.667ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58872024-11-01T22:36:08.667ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58882024-11-01T22:36:08.667ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "513a08b5-bfa9-4188-908a-a099d5f2535f", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
58892024-11-01T22:36:08.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58902024-11-01T22:36:08.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58912024-11-01T22:36:08.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58922024-11-01T22:36:08.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58932024-11-01T22:36:08.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58942024-11-01T22:36:08.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58952024-11-01T22:36:08.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58962024-11-01T22:36:08.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58972024-11-01T22:36:08.673ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58982024-11-01T22:36:08.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58992024-11-01T22:36:08.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59002024-11-01T22:36:08.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59012024-11-01T22:36:08.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022024-11-01T22:36:08.676ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59032024-11-01T22:36:08.676ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59042024-11-01T22:36:08.676ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "851b195c-ef35-459b-8351-2c84ddda8cce", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
59052024-11-01T22:36:08.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59062024-11-01T22:36:08.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59072024-11-01T22:36:08.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59082024-11-01T22:36:08.678ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 238.24544ms iteration = 23 status = {}
59092024-11-01T22:36:08.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59102024-11-01T22:36:08.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59112024-11-01T22:36:08.686ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
59122024-11-01T22:36:08.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59132024-11-01T22:36:08.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59142024-11-01T22:36:08.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59152024-11-01T22:36:08.697ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "47d6f2cc-c168-40bf-bb43-75d477620518", "content-length": "134", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
59162024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59172024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
59182024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59192024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59202024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59212024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59222024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59232024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59242024-11-01T22:36:08.697ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59252024-11-01T22:36:08.698ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59262024-11-01T22:36:08.698ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
59272024-11-01T22:36:08.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59282024-11-01T22:36:08.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59292024-11-01T22:36:08.700ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59302024-11-01T22:36:08.701ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "526df0bc-3a33-4d19-ba80-f5b835cb7eda", "content-length": "2", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
59312024-11-01T22:36:08.701ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59322024-11-01T22:36:08.701ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab0791bb-2d7a-4076-8d8f-e19a68e8978a", "content-length": "52", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
59332024-11-01T22:36:08.701ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
59342024-11-01T22:36:08.701ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59352024-11-01T22:36:08.769ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59362024-11-01T22:36:08.822ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "17c1077c-7eb3-4131-87ab-d3d138655d6a", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
59372024-11-01T22:36:08.822ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
59382024-11-01T22:36:08.822ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59392024-11-01T22:36:08.823ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3b8e432-8353-4964-b125-874325f8d539", "content-length": "682", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
59402024-11-01T22:36:08.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59412024-11-01T22:36:08.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59422024-11-01T22:36:08.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1be411f-8161-4548-a0b9-045fc86b017b", "content-length": "691", "date": "Fri, 01 Nov 2024 22:36:08 GMT"} })
59432024-11-01T22:36:08.823ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
59442024-11-01T22:36:08.823ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
59452024-11-01T22:36:08.823ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
59462024-11-01T22:36:08.825ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 385.424688ms iteration = 22 status = {}
59472024-11-01T22:36:08.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59482024-11-01T22:36:08.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59492024-11-01T22:36:08.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59502024-11-01T22:36:08.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59512024-11-01T22:36:08.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59522024-11-01T22:36:08.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59532024-11-01T22:36:08.840ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 400.107269ms iteration = 22 status = {}
59542024-11-01T22:36:08.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 47a7d663-4a51-4ba2-88fb-8a3361ac6e4e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59552024-11-01T22:36:08.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 47a7d663-4a51-4ba2-88fb-8a3361ac6e4e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59562024-11-01T22:36:08.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 47a7d663-4a51-4ba2-88fb-8a3361ac6e4e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59572024-11-01T22:36:09.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 34d8c309-1a66-4438-ad5a-04e065084ab9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
59582024-11-01T22:36:09.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 34d8c309-1a66-4438-ad5a-04e065084ab9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
59592024-11-01T22:36:09.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 34d8c309-1a66-4438-ad5a-04e065084ab9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
59602024-11-01T22:36:09.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 597a31d8-d4f7-4214-8206-4358020c2320 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59612024-11-01T22:36:09.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 597a31d8-d4f7-4214-8206-4358020c2320 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59622024-11-01T22:36:09.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 597a31d8-d4f7-4214-8206-4358020c2320 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59632024-11-01T22:36:10.763ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
59642024-11-01T22:36:10.763ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
59652024-11-01T22:36:10.793ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
59662024-11-01T22:36:10.793ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:34421
59672024-11-01T22:36:10.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34421 req_id = df0efe35-c28e-4578-9a5a-5fdce96f4ce2 roles = RoleSet { roles: {} } uri = /metrics/producers
59682024-11-01T22:36:10.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34421 req_id = df0efe35-c28e-4578-9a5a-5fdce96f4ce2 resource = Database result = Ok(()) uri = /metrics/producers
59692024-11-01T22:36:10.803ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
59702024-11-01T22:36:10.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9789 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34421 req_id = df0efe35-c28e-4578-9a5a-5fdce96f4ce2 response_code = 201 uri = /metrics/producers
59712024-11-01T22:36:10.803ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "df0efe35-c28e-4578-9a5a-5fdce96f4ce2", "content-length": "41", "date": "Fri, 01 Nov 2024 22:36:09 GMT"} })
59722024-11-01T22:36:10.804ZDEBGnexus (producer-registration-task): registered with nexus successfully
59732024-11-01T22:36:10.804ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
59742024-11-01T22:36:11.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a4f1de1-2de0-448c-970c-aaa0f3d29c02 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59752024-11-01T22:36:11.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a4f1de1-2de0-448c-970c-aaa0f3d29c02 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59762024-11-01T22:36:11.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a4f1de1-2de0-448c-970c-aaa0f3d29c02 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59772024-11-01T22:36:11.153ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38162
59782024-11-01T22:36:11.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38162 req_id = c9883f02-57a4-4407-9ef9-4b16eeb8c317 roles = RoleSet { roles: {} } uri = /metrics/producers
59792024-11-01T22:36:11.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38162 req_id = c9883f02-57a4-4407-9ef9-4b16eeb8c317 resource = Database result = Ok(()) uri = /metrics/producers
59802024-11-01T22:36:11.164ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = f3786bce-13d3-45c6-95c4-d92d9e1f531e
59812024-11-01T22:36:11.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10967 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38162 req_id = c9883f02-57a4-4407-9ef9-4b16eeb8c317 response_code = 201 uri = /metrics/producers
59822024-11-01T22:36:12.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41f254b2-bca3-4d67-9348-2c3cf7df48e9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59832024-11-01T22:36:12.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41f254b2-bca3-4d67-9348-2c3cf7df48e9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59842024-11-01T22:36:12.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41f254b2-bca3-4d67-9348-2c3cf7df48e9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59852024-11-01T22:36:12.729ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:49226
59862024-11-01T22:36:12.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49226 req_id = 2b8f8a31-bdb3-4366-a306-6ec66022d336 roles = RoleSet { roles: {} } uri = /metrics/producers
59872024-11-01T22:36:12.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49226 req_id = 2b8f8a31-bdb3-4366-a306-6ec66022d336 resource = Database result = Ok(()) uri = /metrics/producers
59882024-11-01T22:36:12.764ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 6a9b750b-1518-4ee5-bf47-863dffe85843
59892024-11-01T22:36:12.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35251 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49226 req_id = 2b8f8a31-bdb3-4366-a306-6ec66022d336 response_code = 201 uri = /metrics/producers
59902024-11-01T22:36:13.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef1d80d1-118e-4557-84fe-efe226f39af0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59912024-11-01T22:36:13.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef1d80d1-118e-4557-84fe-efe226f39af0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59922024-11-01T22:36:13.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ef1d80d1-118e-4557-84fe-efe226f39af0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59932024-11-01T22:36:13.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1418 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = d329077a-947a-41f7-9a0e-e8a645416c80 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
59942024-11-01T22:36:14.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 25d781a4-b880-42c7-bff9-5187b0f83e45 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59952024-11-01T22:36:14.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 25d781a4-b880-42c7-bff9-5187b0f83e45 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59962024-11-01T22:36:14.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 25d781a4-b880-42c7-bff9-5187b0f83e45 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59972024-11-01T22:36:15.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1eb7410f-2825-4cb2-b750-9bcdc612c52d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59982024-11-01T22:36:15.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1eb7410f-2825-4cb2-b750-9bcdc612c52d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
59992024-11-01T22:36:15.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1eb7410f-2825-4cb2-b750-9bcdc612c52d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60002024-11-01T22:36:15.645ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42062
60012024-11-01T22:36:15.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42062 req_id = df5a8ea4-0335-4c7a-8a05-0121643f9930 roles = RoleSet { roles: {} } uri = /metrics/producers
60022024-11-01T22:36:15.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42062 req_id = df5a8ea4-0335-4c7a-8a05-0121643f9930 resource = Database result = Ok(()) uri = /metrics/producers
60032024-11-01T22:36:15.679ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 66c10e19-a80d-4554-a39b-bc1969f7015e
60042024-11-01T22:36:15.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34116 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42062 req_id = df5a8ea4-0335-4c7a-8a05-0121643f9930 response_code = 201 uri = /metrics/producers
60052024-11-01T22:36:16.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a07d4590-00db-4181-9243-a1e949584169 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60062024-11-01T22:36:16.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a07d4590-00db-4181-9243-a1e949584169 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60072024-11-01T22:36:16.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a07d4590-00db-4181-9243-a1e949584169 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60082024-11-01T22:36:17.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 80683e32-ca36-4b7f-ae7e-5d0bfb8f9d0b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60092024-11-01T22:36:17.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 80683e32-ca36-4b7f-ae7e-5d0bfb8f9d0b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60102024-11-01T22:36:17.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 80683e32-ca36-4b7f-ae7e-5d0bfb8f9d0b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60112024-11-01T22:36:18.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d2efc643-c782-405c-b9be-4d0c6d0930a1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60122024-11-01T22:36:18.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d2efc643-c782-405c-b9be-4d0c6d0930a1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60132024-11-01T22:36:18.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d2efc643-c782-405c-b9be-4d0c6d0930a1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60142024-11-01T22:36:18.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
60152024-11-01T22:36:18.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
60162024-11-01T22:36:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60172024-11-01T22:36:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60182024-11-01T22:36:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60192024-11-01T22:36:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60202024-11-01T22:36:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60212024-11-01T22:36:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60222024-11-01T22:36:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60232024-11-01T22:36:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60242024-11-01T22:36:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60252024-11-01T22:36:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60262024-11-01T22:36:18.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60272024-11-01T22:36:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
60282024-11-01T22:36:18.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60292024-11-01T22:36:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60302024-11-01T22:36:18.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
60312024-11-01T22:36:18.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.36284ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
60322024-11-01T22:36:18.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60332024-11-01T22:36:18.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60342024-11-01T22:36:18.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.334181ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60352024-11-01T22:36:19.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d143eca3-a112-40a4-8809-6ead04814653 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60362024-11-01T22:36:19.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d143eca3-a112-40a4-8809-6ead04814653 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60372024-11-01T22:36:19.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d143eca3-a112-40a4-8809-6ead04814653 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60382024-11-01T22:36:19.879ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:39406
60392024-11-01T22:36:19.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39406 req_id = 2f127083-8cbb-4552-8770-7bc6f6d47198 roles = RoleSet { roles: {} } uri = /metrics/producers
60402024-11-01T22:36:19.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39406 req_id = 2f127083-8cbb-4552-8770-7bc6f6d47198 resource = Database result = Ok(()) uri = /metrics/producers
60412024-11-01T22:36:19.894ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
60422024-11-01T22:36:19.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 15158 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39406 req_id = 2f127083-8cbb-4552-8770-7bc6f6d47198 response_code = 201 uri = /metrics/producers
60432024-11-01T22:36:20.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 361227ad-4c96-4782-a4ad-6b27b755edba roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60442024-11-01T22:36:20.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 361227ad-4c96-4782-a4ad-6b27b755edba resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60452024-11-01T22:36:20.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 361227ad-4c96-4782-a4ad-6b27b755edba response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60462024-11-01T22:36:21.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96571a9e-a79d-4619-abb8-3ff4754cab61 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60472024-11-01T22:36:21.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96571a9e-a79d-4619-abb8-3ff4754cab61 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60482024-11-01T22:36:21.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96571a9e-a79d-4619-abb8-3ff4754cab61 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60492024-11-01T22:36:22.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 32491bda-3919-49b0-988b-489b39b511ad roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60502024-11-01T22:36:22.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 32491bda-3919-49b0-988b-489b39b511ad resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60512024-11-01T22:36:22.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 32491bda-3919-49b0-988b-489b39b511ad response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60522024-11-01T22:36:23.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57c28660-cd3f-4b76-bab6-d94b4422a31e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60532024-11-01T22:36:23.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57c28660-cd3f-4b76-bab6-d94b4422a31e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60542024-11-01T22:36:23.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57c28660-cd3f-4b76-bab6-d94b4422a31e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60552024-11-01T22:36:24.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a8f78f73-19d7-4c19-9c76-d1683a66dd54 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60562024-11-01T22:36:24.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a8f78f73-19d7-4c19-9c76-d1683a66dd54 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60572024-11-01T22:36:24.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a8f78f73-19d7-4c19-9c76-d1683a66dd54 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60582024-11-01T22:36:25.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff5860a5-3a01-488d-9aed-127299723215 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60592024-11-01T22:36:25.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff5860a5-3a01-488d-9aed-127299723215 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60602024-11-01T22:36:25.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff5860a5-3a01-488d-9aed-127299723215 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60612024-11-01T22:36:26.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99174bd0-df1b-45cd-87ad-72fc29fcd43c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60622024-11-01T22:36:26.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99174bd0-df1b-45cd-87ad-72fc29fcd43c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60632024-11-01T22:36:26.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 99174bd0-df1b-45cd-87ad-72fc29fcd43c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60642024-11-01T22:36:27.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c54ef424-4699-4169-a8fd-2c8ab94d3a10 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60652024-11-01T22:36:27.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c54ef424-4699-4169-a8fd-2c8ab94d3a10 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60662024-11-01T22:36:27.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c54ef424-4699-4169-a8fd-2c8ab94d3a10 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60672024-11-01T22:36:28.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1434 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 2eac947f-dae0-487a-99f5-2ffe8fbbc8ae response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
60682024-11-01T22:36:28.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7ddae578-927d-4526-9ebe-2c77b3f42207 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60692024-11-01T22:36:28.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7ddae578-927d-4526-9ebe-2c77b3f42207 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60702024-11-01T22:36:28.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7ddae578-927d-4526-9ebe-2c77b3f42207 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60712024-11-01T22:36:28.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
60722024-11-01T22:36:28.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
60732024-11-01T22:36:28.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60742024-11-01T22:36:28.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60752024-11-01T22:36:28.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60762024-11-01T22:36:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60772024-11-01T22:36:28.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60782024-11-01T22:36:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60792024-11-01T22:36:28.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.98412ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60802024-11-01T22:36:28.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60812024-11-01T22:36:28.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60822024-11-01T22:36:28.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60832024-11-01T22:36:28.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60842024-11-01T22:36:28.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60852024-11-01T22:36:28.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60862024-11-01T22:36:28.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60872024-11-01T22:36:28.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
60882024-11-01T22:36:28.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60892024-11-01T22:36:28.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60902024-11-01T22:36:28.487ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
60912024-11-01T22:36:28.487ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.991117ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
60922024-11-01T22:36:29.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6c5e4869-25ba-4a23-8af4-675ffc48e2b9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60932024-11-01T22:36:29.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6c5e4869-25ba-4a23-8af4-675ffc48e2b9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60942024-11-01T22:36:29.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6c5e4869-25ba-4a23-8af4-675ffc48e2b9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60952024-11-01T22:36:30.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 07e29168-00c3-4cfc-9bb3-f7011ae42ac0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60962024-11-01T22:36:30.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 07e29168-00c3-4cfc-9bb3-f7011ae42ac0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60972024-11-01T22:36:30.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 07e29168-00c3-4cfc-9bb3-f7011ae42ac0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60982024-11-01T22:36:31.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df69e456-62d9-44da-a7f6-34751754585e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
60992024-11-01T22:36:31.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df69e456-62d9-44da-a7f6-34751754585e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61002024-11-01T22:36:31.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = df69e456-62d9-44da-a7f6-34751754585e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61012024-11-01T22:36:32.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = eab5df5d-e2d7-4348-8094-56027aca0396 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61022024-11-01T22:36:32.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = eab5df5d-e2d7-4348-8094-56027aca0396 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61032024-11-01T22:36:32.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = eab5df5d-e2d7-4348-8094-56027aca0396 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61042024-11-01T22:36:33.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51c7c7c3-7447-4365-8598-4dd1cb037cf2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61052024-11-01T22:36:33.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51c7c7c3-7447-4365-8598-4dd1cb037cf2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61062024-11-01T22:36:33.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51c7c7c3-7447-4365-8598-4dd1cb037cf2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61072024-11-01T22:36:34.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6c40deb0-364c-410f-8454-3cc6c3d06b31 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61082024-11-01T22:36:34.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6c40deb0-364c-410f-8454-3cc6c3d06b31 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61092024-11-01T22:36:34.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6c40deb0-364c-410f-8454-3cc6c3d06b31 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61102024-11-01T22:36:35.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5926dbf6-d949-4611-b672-d6d1c27cb385 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61112024-11-01T22:36:35.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5926dbf6-d949-4611-b672-d6d1c27cb385 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61122024-11-01T22:36:35.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5926dbf6-d949-4611-b672-d6d1c27cb385 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61132024-11-01T22:36:36.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51815a0e-e15c-4dfe-9bf7-8d149421ff46 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61142024-11-01T22:36:36.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51815a0e-e15c-4dfe-9bf7-8d149421ff46 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61152024-11-01T22:36:36.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 51815a0e-e15c-4dfe-9bf7-8d149421ff46 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61162024-11-01T22:36:37.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20ec83d8-ce60-4909-a435-c88bcc807ef3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61172024-11-01T22:36:37.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20ec83d8-ce60-4909-a435-c88bcc807ef3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61182024-11-01T22:36:37.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 20ec83d8-ce60-4909-a435-c88bcc807ef3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
61192024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
61202024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
61212024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 23.09\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
61222024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
61232024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
61242024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61252024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
61262024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.17\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
61272024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
61282024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
61292024-11-01T22:36:38.440ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
61302024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.35\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
61312024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
61322024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
61332024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61342024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61352024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
61362024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61372024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61382024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
61392024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61402024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
61412024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61422024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
61432024-11-01T22:36:38.440ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
61442024-11-01T22:36:38.440ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61452024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61462024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
61472024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
61482024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61492024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
61502024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61512024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61522024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
61532024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
61542024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.28\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61552024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
61562024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61572024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61582024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
61592024-11-01T22:36:38.441ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61602024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61612024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61622024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
61632024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61642024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
61652024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
61662024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61672024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61682024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61692024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
61702024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61712024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
61722024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61732024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
61742024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.101\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61752024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
61762024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
61772024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
61782024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61792024-11-01T22:36:38.441ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:26:38.441087200 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61802024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61812024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61822024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61832024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61842024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61852024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61862024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61872024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61882024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61892024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61902024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61912024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61922024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61932024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61942024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61952024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61962024-11-01T22:36:38.441ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 469614451 } })
61972024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61982024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61992024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62002024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62012024-11-01T22:36:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62022024-11-01T22:36:38.441ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 469771412 } })
62032024-11-01T22:36:38.442ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
62042024-11-01T22:36:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.39748ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
62052024-11-01T22:36:38.442ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62062024-11-01T22:36:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.203099ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62072024-11-01T22:36:38.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62082024-11-01T22:36:38.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 472239571 } })
62092024-11-01T22:36:38.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
62102024-11-01T22:36:38.444ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62112024-11-01T22:36:38.444ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62122024-11-01T22:36:38.444ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62132024-11-01T22:36:38.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62142024-11-01T22:36:38.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.169701ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62152024-11-01T22:36:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62162024-11-01T22:36:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62172024-11-01T22:36:38.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62182024-11-01T22:36:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62192024-11-01T22:36:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62202024-11-01T22:36:38.446ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62212024-11-01T22:36:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62222024-11-01T22:36:38.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62232024-11-01T22:36:38.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62242024-11-01T22:36:38.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62252024-11-01T22:36:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62262024-11-01T22:36:38.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62272024-11-01T22:36:38.449ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.652646ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
62282024-11-01T22:36:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62292024-11-01T22:36:38.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62302024-11-01T22:36:38.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62312024-11-01T22:36:38.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62322024-11-01T22:36:38.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62332024-11-01T22:36:38.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62342024-11-01T22:36:38.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62352024-11-01T22:36:38.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62362024-11-01T22:36:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62372024-11-01T22:36:38.454ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 482032025 } })
62382024-11-01T22:36:38.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62392024-11-01T22:36:38.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62402024-11-01T22:36:38.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
62412024-11-01T22:36:38.455ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:26:38.441087200 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62422024-11-01T22:36:38.455ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.951026ms iteration = 12 status = {"expiration":"2024-11-01T22:26:38.441087200Z","pruned":[]}
62432024-11-01T22:36:38.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62442024-11-01T22:36:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62452024-11-01T22:36:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62462024-11-01T22:36:38.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62472024-11-01T22:36:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62482024-11-01T22:36:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62492024-11-01T22:36:38.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62502024-11-01T22:36:38.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62512024-11-01T22:36:38.460ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62522024-11-01T22:36:38.460ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62532024-11-01T22:36:38.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62542024-11-01T22:36:38.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62552024-11-01T22:36:38.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62562024-11-01T22:36:38.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62572024-11-01T22:36:38.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62582024-11-01T22:36:38.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62592024-11-01T22:36:38.466ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62602024-11-01T22:36:38.466ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62612024-11-01T22:36:38.466ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62622024-11-01T22:36:38.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62632024-11-01T22:36:38.466ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62642024-11-01T22:36:38.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62652024-11-01T22:36:38.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62662024-11-01T22:36:38.467ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 495496377 } })
62672024-11-01T22:36:38.467ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
62682024-11-01T22:36:38.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692024-11-01T22:36:38.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62702024-11-01T22:36:38.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62712024-11-01T22:36:38.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62722024-11-01T22:36:38.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732024-11-01T22:36:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62742024-11-01T22:36:38.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62752024-11-01T22:36:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62762024-11-01T22:36:38.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62772024-11-01T22:36:38.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62782024-11-01T22:36:38.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792024-11-01T22:36:38.482ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62802024-11-01T22:36:38.482ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62812024-11-01T22:36:38.482ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 41.917349ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62822024-11-01T22:36:38.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
62832024-11-01T22:36:38.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62842024-11-01T22:36:38.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62852024-11-01T22:36:38.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62862024-11-01T22:36:38.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-11-01T22:36:38.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62882024-11-01T22:36:38.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62892024-11-01T22:36:38.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62902024-11-01T22:36:38.494ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62912024-11-01T22:36:38.494ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62922024-11-01T22:36:38.495ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62932024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62942024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.456583ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62952024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62962024-11-01T22:36:38.495ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62972024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 54.661465ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62982024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62992024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63002024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63012024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63022024-11-01T22:36:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63032024-11-01T22:36:38.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63042024-11-01T22:36:38.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63052024-11-01T22:36:38.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63062024-11-01T22:36:38.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.89315ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63072024-11-01T22:36:38.500ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63082024-11-01T22:36:38.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092024-11-01T22:36:38.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63102024-11-01T22:36:38.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112024-11-01T22:36:38.503ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
63122024-11-01T22:36:38.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.960808ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
63132024-11-01T22:36:38.503ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63142024-11-01T22:36:38.503ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
63152024-11-01T22:36:38.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63162024-11-01T22:36:38.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63172024-11-01T22:36:38.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63182024-11-01T22:36:38.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63192024-11-01T22:36:38.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63202024-11-01T22:36:38.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
63212024-11-01T22:36:38.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63222024-11-01T22:36:38.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63232024-11-01T22:36:38.506ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63242024-11-01T22:36:38.506ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63252024-11-01T22:36:38.506ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 65.926771ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63262024-11-01T22:36:38.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63272024-11-01T22:36:38.509ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.878093ms iteration = 23 status = 0
63282024-11-01T22:36:38.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63292024-11-01T22:36:38.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63302024-11-01T22:36:38.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63312024-11-01T22:36:38.521ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
63322024-11-01T22:36:38.521ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63332024-11-01T22:36:38.521ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
63342024-11-01T22:36:38.521ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 80.23741ms iteration = 13 status = {"generation":2}
63352024-11-01T22:36:38.523ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63362024-11-01T22:36:38.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63372024-11-01T22:36:38.526ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63382024-11-01T22:36:38.526ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 86.180975ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63392024-11-01T22:36:38.542ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63402024-11-01T22:36:38.542ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63412024-11-01T22:36:38.542ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63422024-11-01T22:36:38.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63432024-11-01T22:36:38.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63442024-11-01T22:36:38.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63452024-11-01T22:36:38.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63462024-11-01T22:36:38.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63472024-11-01T22:36:38.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63482024-11-01T22:36:38.551ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63492024-11-01T22:36:38.551ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63502024-11-01T22:36:38.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63512024-11-01T22:36:38.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63522024-11-01T22:36:38.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.130864ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63532024-11-01T22:36:38.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542024-11-01T22:36:38.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63552024-11-01T22:36:38.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63562024-11-01T22:36:38.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63572024-11-01T22:36:38.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63582024-11-01T22:36:38.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63592024-11-01T22:36:38.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63602024-11-01T22:36:38.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63612024-11-01T22:36:38.560ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
63622024-11-01T22:36:38.560ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63632024-11-01T22:36:38.560ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
63642024-11-01T22:36:38.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 120.030712ms iteration = 13 status = {"generation":1}
63652024-11-01T22:36:38.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63662024-11-01T22:36:38.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63672024-11-01T22:36:38.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63682024-11-01T22:36:38.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63692024-11-01T22:36:38.567ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63702024-11-01T22:36:38.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63712024-11-01T22:36:38.586ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
63722024-11-01T22:36:38.586ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63732024-11-01T22:36:38.586ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9def548-b498-481f-a6dd-c8715c6e6172", "content-length": "26", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
63742024-11-01T22:36:38.586ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63752024-11-01T22:36:38.589ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63762024-11-01T22:36:38.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63772024-11-01T22:36:38.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63782024-11-01T22:36:38.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63792024-11-01T22:36:38.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63802024-11-01T22:36:38.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63812024-11-01T22:36:38.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63822024-11-01T22:36:38.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63832024-11-01T22:36:38.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63842024-11-01T22:36:38.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63852024-11-01T22:36:38.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63862024-11-01T22:36:38.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 44d210f3-cda0-448b-a1af-9ca9415926aa roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
63872024-11-01T22:36:38.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 44d210f3-cda0-448b-a1af-9ca9415926aa resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
63882024-11-01T22:36:38.632ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
63892024-11-01T22:36:38.632ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 191.295933ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63902024-11-01T22:36:38.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 44d210f3-cda0-448b-a1af-9ca9415926aa response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
63912024-11-01T22:36:38.638ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 198.012344ms iteration = 27 status = {"physical_disks_added":0}
63922024-11-01T22:36:38.677ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
63932024-11-01T22:36:38.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63942024-11-01T22:36:38.760ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
63952024-11-01T22:36:38.760ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63962024-11-01T22:36:38.760ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc90cdb2-43a0-442f-8691-d9e239667629", "content-length": "26", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
63972024-11-01T22:36:38.760ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63982024-11-01T22:36:38.763ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63992024-11-01T22:36:38.773ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64002024-11-01T22:36:38.773ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fa8ed19-0f5d-4ae9-bc40-136c54716f43", "content-length": "1", "date": "Fri, 01 Nov 2024 22:36:37 GMT"} })
64012024-11-01T22:36:38.777ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64022024-11-01T22:36:38.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64032024-11-01T22:36:38.778ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
64042024-11-01T22:36:38.778ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64052024-11-01T22:36:38.778ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83efebca-0f9b-496a-ab15-898e645da928", "content-length": "26", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64062024-11-01T22:36:38.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64072024-11-01T22:36:38.780ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
64082024-11-01T22:36:38.796ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64092024-11-01T22:36:38.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64102024-11-01T22:36:38.796ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d66ddfc-34b7-471b-a2f6-2a50e974a638", "content-length": "372", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64112024-11-01T22:36:38.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64122024-11-01T22:36:38.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64132024-11-01T22:36:38.798ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 357.761337ms iteration = 23 status = null
64142024-11-01T22:36:38.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64152024-11-01T22:36:38.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4071a6ea-e881-4ae7-9263-da39a91929a7", "content-length": "691", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64162024-11-01T22:36:38.839ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64172024-11-01T22:36:38.839ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64182024-11-01T22:36:38.839ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64192024-11-01T22:36:38.840ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 399.871877ms iteration = 23 status = {}
64202024-11-01T22:36:38.859ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64212024-11-01T22:36:38.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64222024-11-01T22:36:38.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cce05795-3ca7-4f50-bb59-628dd9f18f2c", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64232024-11-01T22:36:38.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64242024-11-01T22:36:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64252024-11-01T22:36:38.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64262024-11-01T22:36:38.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64272024-11-01T22:36:38.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64282024-11-01T22:36:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64292024-11-01T22:36:38.869ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64302024-11-01T22:36:38.869ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64312024-11-01T22:36:38.870ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3eaf8413-440f-4f36-a1e1-3a84e3cecfc2", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64322024-11-01T22:36:38.872ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 431.624018ms iteration = 24 status = {}
64332024-11-01T22:36:38.892ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 451.425219ms iteration = 23 status = {}
64342024-11-01T22:36:38.899ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64352024-11-01T22:36:38.956ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
64362024-11-01T22:36:38.956ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f8bbe869-03f5-4fa2-a7ce-0d98017332a1", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64372024-11-01T22:36:38.956ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64382024-11-01T22:36:38.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3f14f5b1-cdea-4395-ba1b-2af0ab46b4e4", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64392024-11-01T22:36:38.958ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64402024-11-01T22:36:38.960ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64412024-11-01T22:36:38.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 520.0036ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64422024-11-01T22:36:38.977ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64432024-11-01T22:36:38.977ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "02fd3921-87fb-459f-8da4-18e6b983f86c", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
64442024-11-01T22:36:38.977ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
64452024-11-01T22:36:38.980ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "05950e1b-fc5e-44b2-abb0-42238f2c76b5", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
64462024-11-01T22:36:38.980ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
64472024-11-01T22:36:38.982ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "de09c997-4d76-4b04-8bc1-acf3fc806389", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
64482024-11-01T22:36:38.982ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
64492024-11-01T22:36:38.984ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
64502024-11-01T22:36:38.984ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 543.85301ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64512024-11-01T22:36:39.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64522024-11-01T22:36:39.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64532024-11-01T22:36:39.042ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
64542024-11-01T22:36:39.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64552024-11-01T22:36:39.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64562024-11-01T22:36:39.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64572024-11-01T22:36:39.052ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdceef0d-6b74-4269-a222-d79753964d23", "content-length": "134", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64582024-11-01T22:36:39.052ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64592024-11-01T22:36:39.052ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
64602024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64612024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64622024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64632024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64642024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64652024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64662024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64672024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64682024-11-01T22:36:39.053ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
64692024-11-01T22:36:39.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64702024-11-01T22:36:39.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64712024-11-01T22:36:39.055ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64722024-11-01T22:36:39.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0612623-e1d7-4f6d-893b-dcec6a3ab85e", "content-length": "2", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64732024-11-01T22:36:39.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64742024-11-01T22:36:39.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cc1dc67-7c23-4bdb-a031-accdb0c99562", "content-length": "52", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64752024-11-01T22:36:39.056ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
64762024-11-01T22:36:39.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64772024-11-01T22:36:39.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 33dd174c-2458-49d3-9d38-534e58ac9551 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64782024-11-01T22:36:39.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 33dd174c-2458-49d3-9d38-534e58ac9551 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64792024-11-01T22:36:39.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 33dd174c-2458-49d3-9d38-534e58ac9551 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64802024-11-01T22:36:39.255ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c53e8c95-7445-4f60-aba3-5b646645432d", "date": "Fri, 01 Nov 2024 22:36:38 GMT"} })
64812024-11-01T22:36:39.255ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
64822024-11-01T22:36:39.255ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64832024-11-01T22:36:39.256ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "27626aa9-ad54-4f7a-a92f-482c8a9730e8", "content-length": "682", "date": "Fri, 01 Nov 2024 22:36:39 GMT"} })
64842024-11-01T22:36:39.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64852024-11-01T22:36:39.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64862024-11-01T22:36:39.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64872024-11-01T22:36:39.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64882024-11-01T22:36:39.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64892024-11-01T22:36:39.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64902024-11-01T22:36:39.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64912024-11-01T22:36:39.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64922024-11-01T22:36:39.273ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 832.996978ms iteration = 23 status = {}
64932024-11-01T22:36:39.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f3740ec-3516-437b-a7e8-1606f98e9efd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
64942024-11-01T22:36:39.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f3740ec-3516-437b-a7e8-1606f98e9efd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
64952024-11-01T22:36:39.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f3740ec-3516-437b-a7e8-1606f98e9efd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
64962024-11-01T22:36:40.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e85d15a7-5200-4fb8-9da2-6caaeb5765d3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
64972024-11-01T22:36:40.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e85d15a7-5200-4fb8-9da2-6caaeb5765d3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
64982024-11-01T22:36:40.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e85d15a7-5200-4fb8-9da2-6caaeb5765d3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
64992024-11-01T22:36:41.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3edf973d-15fd-4e1d-a714-288f67c3cb46 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65002024-11-01T22:36:41.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3edf973d-15fd-4e1d-a714-288f67c3cb46 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65012024-11-01T22:36:41.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3edf973d-15fd-4e1d-a714-288f67c3cb46 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65022024-11-01T22:36:42.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0efa65ab-e3f1-4473-8263-bf2a5ea57e5e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65032024-11-01T22:36:42.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0efa65ab-e3f1-4473-8263-bf2a5ea57e5e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65042024-11-01T22:36:42.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0efa65ab-e3f1-4473-8263-bf2a5ea57e5e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65052024-11-01T22:36:43.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1348 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 3d1649ab-c795-4174-9440-f3d6d980c894 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
65062024-11-01T22:36:43.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f865667d-4c1e-4383-8d4e-33b525073ce1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65072024-11-01T22:36:43.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f865667d-4c1e-4383-8d4e-33b525073ce1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65082024-11-01T22:36:43.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f865667d-4c1e-4383-8d4e-33b525073ce1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65092024-11-01T22:36:44.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c5c97db-2fea-447a-b33a-2c70ca80de74 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65102024-11-01T22:36:44.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c5c97db-2fea-447a-b33a-2c70ca80de74 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65112024-11-01T22:36:44.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c5c97db-2fea-447a-b33a-2c70ca80de74 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65122024-11-01T22:36:45.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 60a615d1-0b7c-4c2b-8804-2b1b85ebff4f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65132024-11-01T22:36:45.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 60a615d1-0b7c-4c2b-8804-2b1b85ebff4f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65142024-11-01T22:36:45.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 60a615d1-0b7c-4c2b-8804-2b1b85ebff4f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65152024-11-01T22:36:46.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 88c5fb51-10cc-435d-833f-fa6319c48e60 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65162024-11-01T22:36:46.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 88c5fb51-10cc-435d-833f-fa6319c48e60 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65172024-11-01T22:36:46.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 88c5fb51-10cc-435d-833f-fa6319c48e60 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65182024-11-01T22:36:47.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d2364592-2200-4590-a7fc-3945cbc693f3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65192024-11-01T22:36:47.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d2364592-2200-4590-a7fc-3945cbc693f3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65202024-11-01T22:36:47.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d2364592-2200-4590-a7fc-3945cbc693f3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65212024-11-01T22:36:48.187ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:43987
65222024-11-01T22:36:48.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 3b46ab4a-aa14-44dc-8a48-548a6640a692 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
65232024-11-01T22:36:48.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 3b46ab4a-aa14-44dc-8a48-548a6640a692 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
65242024-11-01T22:36:48.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 3b46ab4a-aa14-44dc-8a48-548a6640a692 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
65252024-11-01T22:36:48.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 9cbc6614-0f91-4dea-953a-e4b84399c6ed roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
65262024-11-01T22:36:48.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 9cbc6614-0f91-4dea-953a-e4b84399c6ed resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
65272024-11-01T22:36:48.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 9cbc6614-0f91-4dea-953a-e4b84399c6ed response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
65282024-11-01T22:36:48.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
65292024-11-01T22:36:48.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
65302024-11-01T22:36:48.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65312024-11-01T22:36:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65322024-11-01T22:36:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65332024-11-01T22:36:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65342024-11-01T22:36:48.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65352024-11-01T22:36:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65362024-11-01T22:36:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65372024-11-01T22:36:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65382024-11-01T22:36:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65392024-11-01T22:36:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65402024-11-01T22:36:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65412024-11-01T22:36:48.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65422024-11-01T22:36:48.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65432024-11-01T22:36:48.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
65442024-11-01T22:36:48.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65452024-11-01T22:36:48.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65462024-11-01T22:36:48.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
65472024-11-01T22:36:48.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.759793ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
65482024-11-01T22:36:48.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.806487ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65492024-11-01T22:36:48.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d9d53032-7c2f-4269-a620-d12a1aec1de2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65502024-11-01T22:36:48.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d9d53032-7c2f-4269-a620-d12a1aec1de2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65512024-11-01T22:36:48.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d9d53032-7c2f-4269-a620-d12a1aec1de2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65522024-11-01T22:36:49.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 98b2dac9-c5e0-42fe-abca-d8fb9ea8e133 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65532024-11-01T22:36:49.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 98b2dac9-c5e0-42fe-abca-d8fb9ea8e133 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65542024-11-01T22:36:49.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 98b2dac9-c5e0-42fe-abca-d8fb9ea8e133 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65552024-11-01T22:36:50.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5850e99-c345-4d54-a575-0efa3624ce88 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65562024-11-01T22:36:50.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5850e99-c345-4d54-a575-0efa3624ce88 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65572024-11-01T22:36:50.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5850e99-c345-4d54-a575-0efa3624ce88 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65582024-11-01T22:36:51.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aac10c12-bf86-4b01-ae36-b6aa87183941 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65592024-11-01T22:36:51.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aac10c12-bf86-4b01-ae36-b6aa87183941 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65602024-11-01T22:36:51.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aac10c12-bf86-4b01-ae36-b6aa87183941 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65612024-11-01T22:36:52.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3af333b-29d2-493f-ac60-ad7b855d0d72 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65622024-11-01T22:36:52.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3af333b-29d2-493f-ac60-ad7b855d0d72 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65632024-11-01T22:36:52.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3af333b-29d2-493f-ac60-ad7b855d0d72 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65642024-11-01T22:36:53.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57e4e38c-02d8-4895-85db-5104e428cd6f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65652024-11-01T22:36:53.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57e4e38c-02d8-4895-85db-5104e428cd6f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65662024-11-01T22:36:53.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57e4e38c-02d8-4895-85db-5104e428cd6f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65672024-11-01T22:36:55.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f114d911-55bb-40a9-9f36-8ffeefc3d669 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65682024-11-01T22:36:55.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f114d911-55bb-40a9-9f36-8ffeefc3d669 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65692024-11-01T22:36:55.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f114d911-55bb-40a9-9f36-8ffeefc3d669 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65702024-11-01T22:36:56.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 18a258c5-3975-4d89-8365-706623af3360 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65712024-11-01T22:36:56.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 18a258c5-3975-4d89-8365-706623af3360 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65722024-11-01T22:36:56.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 18a258c5-3975-4d89-8365-706623af3360 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65732024-11-01T22:36:57.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 27f07d2d-b630-439d-9fa4-0e58eacd5e67 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65742024-11-01T22:36:57.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 27f07d2d-b630-439d-9fa4-0e58eacd5e67 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65752024-11-01T22:36:57.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 27f07d2d-b630-439d-9fa4-0e58eacd5e67 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65762024-11-01T22:36:58.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 091bb17a-04b6-4d73-93a4-aaa4b69a48ec roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65772024-11-01T22:36:58.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 091bb17a-04b6-4d73-93a4-aaa4b69a48ec resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65782024-11-01T22:36:58.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 091bb17a-04b6-4d73-93a4-aaa4b69a48ec response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
65792024-11-01T22:36:58.196ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1503 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = cb9a3555-5eda-4de9-8578-49877cd95ba9 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
65802024-11-01T22:36:58.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
65812024-11-01T22:36:58.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65822024-11-01T22:36:58.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
65832024-11-01T22:36:58.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65842024-11-01T22:36:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65852024-11-01T22:36:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65862024-11-01T22:36:58.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65872024-11-01T22:36:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65882024-11-01T22:36:58.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65892024-11-01T22:36:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65902024-11-01T22:36:58.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65912024-11-01T22:36:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65922024-11-01T22:36:58.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65932024-11-01T22:36:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
65942024-11-01T22:36:58.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65952024-11-01T22:36:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65962024-11-01T22:36:58.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
65972024-11-01T22:36:58.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.979885ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
65982024-11-01T22:36:58.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65992024-11-01T22:36:58.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66002024-11-01T22:36:58.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.628965ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66012024-11-01T22:36:59.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b7118b8-ac6a-4b41-9cdf-ac2f3c5cde6d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66022024-11-01T22:36:59.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b7118b8-ac6a-4b41-9cdf-ac2f3c5cde6d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66032024-11-01T22:36:59.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b7118b8-ac6a-4b41-9cdf-ac2f3c5cde6d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66042024-11-01T22:37:00.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 727508c2-ba7d-4fa2-bee6-31f9bd1a7896 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66052024-11-01T22:37:00.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 727508c2-ba7d-4fa2-bee6-31f9bd1a7896 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66062024-11-01T22:37:00.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 727508c2-ba7d-4fa2-bee6-31f9bd1a7896 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66072024-11-01T22:37:01.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5276b060-8777-45da-9043-18351aedf4ac roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66082024-11-01T22:37:01.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5276b060-8777-45da-9043-18351aedf4ac resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66092024-11-01T22:37:01.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5276b060-8777-45da-9043-18351aedf4ac response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66102024-11-01T22:37:02.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 91ad98be-3190-418f-a8b5-2262b4d04c27 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66112024-11-01T22:37:02.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 91ad98be-3190-418f-a8b5-2262b4d04c27 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66122024-11-01T22:37:02.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 91ad98be-3190-418f-a8b5-2262b4d04c27 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66132024-11-01T22:37:03.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1c8e74f7-6470-4bf1-b871-f7eab79a2793 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66142024-11-01T22:37:03.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1c8e74f7-6470-4bf1-b871-f7eab79a2793 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66152024-11-01T22:37:03.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1c8e74f7-6470-4bf1-b871-f7eab79a2793 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66162024-11-01T22:37:04.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f2b405b8-33d6-4615-9e4e-ce642107de50 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66172024-11-01T22:37:04.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f2b405b8-33d6-4615-9e4e-ce642107de50 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66182024-11-01T22:37:04.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f2b405b8-33d6-4615-9e4e-ce642107de50 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66192024-11-01T22:37:05.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ab4b7b19-5c70-41e4-87f1-38175d7d22dc roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66202024-11-01T22:37:05.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ab4b7b19-5c70-41e4-87f1-38175d7d22dc resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66212024-11-01T22:37:05.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ab4b7b19-5c70-41e4-87f1-38175d7d22dc response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66222024-11-01T22:37:06.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ad0db76b-0f41-4093-a7b4-df98ce7f31c0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66232024-11-01T22:37:06.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ad0db76b-0f41-4093-a7b4-df98ce7f31c0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66242024-11-01T22:37:06.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1687 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ad0db76b-0f41-4093-a7b4-df98ce7f31c0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66252024-11-01T22:37:07.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f59e6ca-1507-4e1a-a450-3397e495e6d4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66262024-11-01T22:37:07.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f59e6ca-1507-4e1a-a450-3397e495e6d4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66272024-11-01T22:37:07.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f59e6ca-1507-4e1a-a450-3397e495e6d4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66282024-11-01T22:37:08.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1d9a1c1a-a23e-4696-ae37-d1082ae3b421 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66292024-11-01T22:37:08.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1d9a1c1a-a23e-4696-ae37-d1082ae3b421 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66302024-11-01T22:37:08.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1d9a1c1a-a23e-4696-ae37-d1082ae3b421 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
66312024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
66322024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.97\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
66332024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
66342024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
66352024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.06\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
66362024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
66372024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.089\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66382024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66392024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
66402024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
66412024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.27\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66422024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66432024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
66442024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
66452024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66462024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
66472024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66482024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
66492024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66502024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
66512024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66522024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
66532024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
66542024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66552024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66562024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66572024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
66582024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66592024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
66602024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
66612024-11-01T22:37:08.441ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66622024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66632024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66642024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
66652024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66662024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66672024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66682024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66692024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66702024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66712024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66722024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66732024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66742024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66752024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66762024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66772024-11-01T22:37:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66782024-11-01T22:37:08.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66792024-11-01T22:37:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66802024-11-01T22:37:08.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66812024-11-01T22:37:08.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.699058ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66822024-11-01T22:37:08.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 472412682 } })
66832024-11-01T22:37:08.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
66842024-11-01T22:37:08.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66852024-11-01T22:37:08.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66862024-11-01T22:37:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66872024-11-01T22:37:08.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66882024-11-01T22:37:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66892024-11-01T22:37:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66902024-11-01T22:37:08.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66912024-11-01T22:37:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66922024-11-01T22:37:08.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66932024-11-01T22:37:08.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66942024-11-01T22:37:08.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 476576694 } })
66952024-11-01T22:37:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66962024-11-01T22:37:08.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66972024-11-01T22:37:08.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
66982024-11-01T22:37:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66992024-11-01T22:37:08.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67002024-11-01T22:37:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67012024-11-01T22:37:08.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67022024-11-01T22:37:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67032024-11-01T22:37:08.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67042024-11-01T22:37:08.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67052024-11-01T22:37:08.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67062024-11-01T22:37:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67072024-11-01T22:37:08.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67082024-11-01T22:37:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67092024-11-01T22:37:08.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67102024-11-01T22:37:08.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 484340473 } })
67112024-11-01T22:37:08.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
67122024-11-01T22:37:08.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67132024-11-01T22:37:08.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67142024-11-01T22:37:08.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67152024-11-01T22:37:08.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67162024-11-01T22:37:08.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
67172024-11-01T22:37:08.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67182024-11-01T22:37:08.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67192024-11-01T22:37:08.476ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
67202024-11-01T22:37:08.476ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.420459ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
67212024-11-01T22:37:08.481ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67222024-11-01T22:37:08.481ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67232024-11-01T22:37:08.481ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67242024-11-01T22:37:08.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67252024-11-01T22:37:08.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67262024-11-01T22:37:08.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67272024-11-01T22:37:08.484ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67282024-11-01T22:37:08.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67292024-11-01T22:37:08.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67302024-11-01T22:37:08.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67312024-11-01T22:37:08.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67322024-11-01T22:37:08.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.397817ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67332024-11-01T22:37:08.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67342024-11-01T22:37:08.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67352024-11-01T22:37:08.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67362024-11-01T22:37:08.490ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67372024-11-01T22:37:08.490ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.702097ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67382024-11-01T22:37:08.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67392024-11-01T22:37:08.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.770658ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67402024-11-01T22:37:08.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67412024-11-01T22:37:08.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67422024-11-01T22:37:08.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67432024-11-01T22:37:08.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67442024-11-01T22:37:08.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67452024-11-01T22:37:08.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67462024-11-01T22:37:08.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
67472024-11-01T22:37:08.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67482024-11-01T22:37:08.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67492024-11-01T22:37:08.496ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.765003ms iteration = 24 status = 0
67502024-11-01T22:37:08.514ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67512024-11-01T22:37:08.514ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67522024-11-01T22:37:08.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67532024-11-01T22:37:08.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67542024-11-01T22:37:08.544ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
67552024-11-01T22:37:08.544ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67562024-11-01T22:37:08.545ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad104da8-691a-4df9-b8b7-7a853512043b", "content-length": "26", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
67572024-11-01T22:37:08.545ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67582024-11-01T22:37:08.547ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67592024-11-01T22:37:08.558ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67602024-11-01T22:37:08.558ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67612024-11-01T22:37:08.558ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.281291ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67622024-11-01T22:37:08.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67632024-11-01T22:37:08.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67642024-11-01T22:37:08.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67652024-11-01T22:37:08.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67662024-11-01T22:37:08.572ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.944775ms iteration = 28 status = {"physical_disks_added":0}
67672024-11-01T22:37:08.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67682024-11-01T22:37:08.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67692024-11-01T22:37:08.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67702024-11-01T22:37:08.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67712024-11-01T22:37:08.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67722024-11-01T22:37:08.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67732024-11-01T22:37:08.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67742024-11-01T22:37:08.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67752024-11-01T22:37:08.617ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
67762024-11-01T22:37:08.617ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67772024-11-01T22:37:08.617ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb5d4c59-6ed8-401b-8231-d28a91956bc1", "content-length": "26", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
67782024-11-01T22:37:08.617ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67792024-11-01T22:37:08.619ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67802024-11-01T22:37:08.669ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
67812024-11-01T22:37:08.669ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67822024-11-01T22:37:08.670ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dba8e207-53ee-4dde-bf11-55da972b7536", "content-length": "26", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
67832024-11-01T22:37:08.670ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67842024-11-01T22:37:08.671ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
67852024-11-01T22:37:08.738ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67862024-11-01T22:37:08.738ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e62e8af3-0433-42c1-acfb-0df1e8caf3ee", "content-length": "1", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
67872024-11-01T22:37:08.740ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67882024-11-01T22:37:08.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67892024-11-01T22:37:08.742ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 300.990906ms iteration = 24 status = null
67902024-11-01T22:37:08.760ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 319.136484ms iteration = 24 status = {}
67912024-11-01T22:37:08.776ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67922024-11-01T22:37:08.776ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67932024-11-01T22:37:08.776ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f056ad12-7397-402a-9a39-6ba0e1c11ed2", "content-length": "372", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
67942024-11-01T22:37:08.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67952024-11-01T22:37:08.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67962024-11-01T22:37:08.780ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67972024-11-01T22:37:08.780ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0103d0d-3d32-4a60-831c-350f51604f3a", "content-length": "691", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
67982024-11-01T22:37:08.780ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67992024-11-01T22:37:08.780ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68002024-11-01T22:37:08.780ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68012024-11-01T22:37:08.781ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 340.610027ms iteration = 24 status = {}
68022024-11-01T22:37:08.790ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
68032024-11-01T22:37:08.790ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68042024-11-01T22:37:08.790ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e92b276e-7b94-463b-8632-85fe6379c727", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
68052024-11-01T22:37:08.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68062024-11-01T22:37:08.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68072024-11-01T22:37:08.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68082024-11-01T22:37:08.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68092024-11-01T22:37:08.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68102024-11-01T22:37:08.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68112024-11-01T22:37:08.798ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68122024-11-01T22:37:08.798ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68132024-11-01T22:37:08.798ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5433ba46-a117-4152-8ae8-66b5f3dc97db", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
68142024-11-01T22:37:08.800ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.980186ms iteration = 25 status = {}
68152024-11-01T22:37:08.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68162024-11-01T22:37:08.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68172024-11-01T22:37:08.851ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
68182024-11-01T22:37:08.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68192024-11-01T22:37:08.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68202024-11-01T22:37:08.858ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68212024-11-01T22:37:08.858ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7da90dc6-19cb-4c85-b358-236ff2489e20", "content-length": "134", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
68222024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68232024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
68242024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68252024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68262024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68272024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68282024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68292024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68302024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68312024-11-01T22:37:08.858ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68322024-11-01T22:37:08.859ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
68332024-11-01T22:37:08.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68342024-11-01T22:37:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68352024-11-01T22:37:08.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68362024-11-01T22:37:08.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bebbf1d2-d5ad-42aa-91d4-542969aeea27", "content-length": "2", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
68372024-11-01T22:37:08.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68382024-11-01T22:37:08.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "37448cf6-6fc0-463e-81bd-1efb53750edf", "content-length": "52", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
68392024-11-01T22:37:08.861ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
68402024-11-01T22:37:08.861ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68412024-11-01T22:37:09.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7346a20c-4e02-4d0e-b970-6f6b07ec564c", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
68422024-11-01T22:37:09.060ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
68432024-11-01T22:37:09.060ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68442024-11-01T22:37:09.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a4904f8-b51f-4778-93f2-74d5e1c5284f", "content-length": "682", "date": "Fri, 01 Nov 2024 22:37:08 GMT"} })
68452024-11-01T22:37:09.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68462024-11-01T22:37:09.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68472024-11-01T22:37:09.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68482024-11-01T22:37:09.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68492024-11-01T22:37:09.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68502024-11-01T22:37:09.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68512024-11-01T22:37:09.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68522024-11-01T22:37:09.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68532024-11-01T22:37:09.077ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 636.078321ms iteration = 24 status = {}
68542024-11-01T22:37:09.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9f033fd0-67df-4b8a-a3ed-6a0a9e39fa55 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68552024-11-01T22:37:09.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9f033fd0-67df-4b8a-a3ed-6a0a9e39fa55 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
68562024-11-01T22:37:09.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9f033fd0-67df-4b8a-a3ed-6a0a9e39fa55 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
68572024-11-01T22:37:09.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff98dde2-fb15-4967-8236-abaf7a8954f8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68582024-11-01T22:37:09.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff98dde2-fb15-4967-8236-abaf7a8954f8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68592024-11-01T22:37:09.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff98dde2-fb15-4967-8236-abaf7a8954f8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68602024-11-01T22:37:10.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c53c3ff4-1936-483b-9701-8af7a1f1a2a5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68612024-11-01T22:37:10.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c53c3ff4-1936-483b-9701-8af7a1f1a2a5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68622024-11-01T22:37:10.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c53c3ff4-1936-483b-9701-8af7a1f1a2a5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68632024-11-01T22:37:11.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fd5cfc8a-39b2-4c23-a570-74f6f7f0ab1e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68642024-11-01T22:37:11.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fd5cfc8a-39b2-4c23-a570-74f6f7f0ab1e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68652024-11-01T22:37:11.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fd5cfc8a-39b2-4c23-a570-74f6f7f0ab1e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68662024-11-01T22:37:12.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ea4a627-ecfb-4d25-8afa-01a2051c32ce roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68672024-11-01T22:37:12.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ea4a627-ecfb-4d25-8afa-01a2051c32ce resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68682024-11-01T22:37:12.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ea4a627-ecfb-4d25-8afa-01a2051c32ce response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68692024-11-01T22:37:13.196ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = f4fb3401-c211-41f3-8848-bb4b3dba7f73 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
68702024-11-01T22:37:13.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aae1f366-0354-4e75-ae91-2beeafd514f9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68712024-11-01T22:37:13.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aae1f366-0354-4e75-ae91-2beeafd514f9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68722024-11-01T22:37:13.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aae1f366-0354-4e75-ae91-2beeafd514f9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68732024-11-01T22:37:14.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 87983945-11b7-4c02-843c-2e797fb080d2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68742024-11-01T22:37:14.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 87983945-11b7-4c02-843c-2e797fb080d2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68752024-11-01T22:37:14.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 87983945-11b7-4c02-843c-2e797fb080d2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68762024-11-01T22:37:15.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5ee00e2-6a39-49ff-b86e-67df315b56d2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68772024-11-01T22:37:15.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5ee00e2-6a39-49ff-b86e-67df315b56d2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68782024-11-01T22:37:15.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d5ee00e2-6a39-49ff-b86e-67df315b56d2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68792024-11-01T22:37:16.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4def8a2-997c-4927-9934-545676686204 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68802024-11-01T22:37:16.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4def8a2-997c-4927-9934-545676686204 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68812024-11-01T22:37:16.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4def8a2-997c-4927-9934-545676686204 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68822024-11-01T22:37:17.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c16caf4b-15f5-4f38-8324-0516b63d0e1d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68832024-11-01T22:37:17.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c16caf4b-15f5-4f38-8324-0516b63d0e1d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68842024-11-01T22:37:17.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c16caf4b-15f5-4f38-8324-0516b63d0e1d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
68852024-11-01T22:37:18.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
68862024-11-01T22:37:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68872024-11-01T22:37:18.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
68882024-11-01T22:37:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68892024-11-01T22:37:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68902024-11-01T22:37:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68912024-11-01T22:37:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68922024-11-01T22:37:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68932024-11-01T22:37:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68942024-11-01T22:37:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68952024-11-01T22:37:18.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68962024-11-01T22:37:18.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68972024-11-01T22:37:18.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68982024-11-01T22:37:18.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
68992024-11-01T22:37:18.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69002024-11-01T22:37:18.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69012024-11-01T22:37:18.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
69022024-11-01T22:37:18.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.171379ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
69032024-11-01T22:37:18.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69042024-11-01T22:37:18.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69052024-11-01T22:37:18.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.321013ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69062024-11-01T22:37:18.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e91eb24-8caf-4140-ac84-2c2f6eee9393 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69072024-11-01T22:37:18.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e91eb24-8caf-4140-ac84-2c2f6eee9393 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69082024-11-01T22:37:18.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e91eb24-8caf-4140-ac84-2c2f6eee9393 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69092024-11-01T22:37:19.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ec6b2393-7ecc-468a-a64b-ff8e961968a2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69102024-11-01T22:37:19.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ec6b2393-7ecc-468a-a64b-ff8e961968a2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69112024-11-01T22:37:19.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ec6b2393-7ecc-468a-a64b-ff8e961968a2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69122024-11-01T22:37:20.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce8991b4-7f6b-440c-bcce-373cc3755e40 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69132024-11-01T22:37:20.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce8991b4-7f6b-440c-bcce-373cc3755e40 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69142024-11-01T22:37:20.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce8991b4-7f6b-440c-bcce-373cc3755e40 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69152024-11-01T22:37:21.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d4443c7-d59f-4551-aef8-7b6fbb6ad36f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69162024-11-01T22:37:21.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d4443c7-d59f-4551-aef8-7b6fbb6ad36f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69172024-11-01T22:37:21.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0d4443c7-d59f-4551-aef8-7b6fbb6ad36f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69182024-11-01T22:37:22.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a1e05a65-8321-440f-9346-74c641e28932 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69192024-11-01T22:37:22.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a1e05a65-8321-440f-9346-74c641e28932 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69202024-11-01T22:37:22.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a1e05a65-8321-440f-9346-74c641e28932 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69212024-11-01T22:37:23.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bf95a11-d09a-4084-9ed8-7ccb5651d554 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69222024-11-01T22:37:23.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bf95a11-d09a-4084-9ed8-7ccb5651d554 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69232024-11-01T22:37:23.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6bf95a11-d09a-4084-9ed8-7ccb5651d554 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69242024-11-01T22:37:24.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc6f5069-6c76-4ddb-9c3c-b5a366028309 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69252024-11-01T22:37:24.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc6f5069-6c76-4ddb-9c3c-b5a366028309 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69262024-11-01T22:37:24.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bc6f5069-6c76-4ddb-9c3c-b5a366028309 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69272024-11-01T22:37:25.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8613e4d4-e64f-47af-8906-ca866a9ee8db roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69282024-11-01T22:37:25.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8613e4d4-e64f-47af-8906-ca866a9ee8db resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69292024-11-01T22:37:25.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8613e4d4-e64f-47af-8906-ca866a9ee8db response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69302024-11-01T22:37:26.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 83316044-41a8-4576-bafc-1e21e65f55f0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69312024-11-01T22:37:26.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 83316044-41a8-4576-bafc-1e21e65f55f0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69322024-11-01T22:37:26.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 83316044-41a8-4576-bafc-1e21e65f55f0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69332024-11-01T22:37:27.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4546ddfa-1b75-4651-b7b1-b9275a21280a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69342024-11-01T22:37:27.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4546ddfa-1b75-4651-b7b1-b9275a21280a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69352024-11-01T22:37:27.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4546ddfa-1b75-4651-b7b1-b9275a21280a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69362024-11-01T22:37:28.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1488 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = b0bef7d9-72bc-4659-a46b-1d27d5ed1438 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
69372024-11-01T22:37:28.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
69382024-11-01T22:37:28.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
69392024-11-01T22:37:28.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69402024-11-01T22:37:28.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69412024-11-01T22:37:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69422024-11-01T22:37:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69432024-11-01T22:37:28.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69442024-11-01T22:37:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69452024-11-01T22:37:28.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69462024-11-01T22:37:28.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.747439ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69472024-11-01T22:37:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69482024-11-01T22:37:28.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69492024-11-01T22:37:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69502024-11-01T22:37:28.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69512024-11-01T22:37:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69522024-11-01T22:37:28.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69532024-11-01T22:37:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
69542024-11-01T22:37:28.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69552024-11-01T22:37:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69562024-11-01T22:37:28.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
69572024-11-01T22:37:28.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.780121ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
69582024-11-01T22:37:28.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 17792f8d-8784-49ec-825c-3de28ce41351 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69592024-11-01T22:37:28.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 17792f8d-8784-49ec-825c-3de28ce41351 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69602024-11-01T22:37:28.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 17792f8d-8784-49ec-825c-3de28ce41351 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69612024-11-01T22:37:29.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9883bdb2-e3df-4ef9-aa9b-f41722fb5cc1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
69622024-11-01T22:37:29.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9883bdb2-e3df-4ef9-aa9b-f41722fb5cc1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
69632024-11-01T22:37:29.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9883bdb2-e3df-4ef9-aa9b-f41722fb5cc1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
69642024-11-01T22:37:29.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = fb158542-e6d4-45bb-9862-5e6cff00465b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
69652024-11-01T22:37:29.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = fb158542-e6d4-45bb-9862-5e6cff00465b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
69662024-11-01T22:37:29.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = fb158542-e6d4-45bb-9862-5e6cff00465b response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
69672024-11-01T22:37:29.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e809a422-2b4b-42cb-9da3-aa54182d32dc roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69682024-11-01T22:37:29.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e809a422-2b4b-42cb-9da3-aa54182d32dc resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69692024-11-01T22:37:29.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e809a422-2b4b-42cb-9da3-aa54182d32dc response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69702024-11-01T22:37:30.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b469d58a-7596-4e8b-a9a8-27f0ae0f2a6d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69712024-11-01T22:37:30.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b469d58a-7596-4e8b-a9a8-27f0ae0f2a6d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69722024-11-01T22:37:30.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b469d58a-7596-4e8b-a9a8-27f0ae0f2a6d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69732024-11-01T22:37:31.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b8f8f61-3ebe-4721-8340-1c81ee19d2f4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69742024-11-01T22:37:31.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b8f8f61-3ebe-4721-8340-1c81ee19d2f4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69752024-11-01T22:37:31.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4b8f8f61-3ebe-4721-8340-1c81ee19d2f4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69762024-11-01T22:37:32.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c02b45d-529e-4d1b-a3d2-f8bf8a1349e5 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69772024-11-01T22:37:32.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c02b45d-529e-4d1b-a3d2-f8bf8a1349e5 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69782024-11-01T22:37:32.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8c02b45d-529e-4d1b-a3d2-f8bf8a1349e5 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69792024-11-01T22:37:33.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = b5743022-b54f-4291-9f2d-2a45d6f3b5d7 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
69802024-11-01T22:37:33.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = b5743022-b54f-4291-9f2d-2a45d6f3b5d7 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
69812024-11-01T22:37:33.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = b5743022-b54f-4291-9f2d-2a45d6f3b5d7 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
69822024-11-01T22:37:33.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 9f673411-e1af-4520-8b26-f89dc525516a roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
69832024-11-01T22:37:33.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 9f673411-e1af-4520-8b26-f89dc525516a resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
69842024-11-01T22:37:33.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = 9f673411-e1af-4520-8b26-f89dc525516a response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
69852024-11-01T22:37:33.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7fea6cab-f17c-48d9-9a83-58848b816768 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69862024-11-01T22:37:33.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7fea6cab-f17c-48d9-9a83-58848b816768 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69872024-11-01T22:37:33.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7fea6cab-f17c-48d9-9a83-58848b816768 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69882024-11-01T22:37:34.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5bdd54ff-e32e-49be-b154-448fcd498134 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69892024-11-01T22:37:34.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5bdd54ff-e32e-49be-b154-448fcd498134 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69902024-11-01T22:37:34.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5bdd54ff-e32e-49be-b154-448fcd498134 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69912024-11-01T22:37:36.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 272cc449-12e5-437b-9581-10492bba2245 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69922024-11-01T22:37:36.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 272cc449-12e5-437b-9581-10492bba2245 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69932024-11-01T22:37:36.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 272cc449-12e5-437b-9581-10492bba2245 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
69942024-11-01T22:37:36.635ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b8cf8cec-5400-40de-870e-36fa2661014d uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T22:37:36.628462809Z }
69952024-11-01T22:37:36.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b8cf8cec-5400-40de-870e-36fa2661014d roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
69962024-11-01T22:37:36.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b8cf8cec-5400-40de-870e-36fa2661014d resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
69972024-11-01T22:37:36.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 14788 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b8cf8cec-5400-40de-870e-36fa2661014d response_code = 204 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
69982024-11-01T22:37:36.644ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 509750b0-4901-4d7a-b944-82bb64c4c4c5 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T22:37:36.643858296Z }
69992024-11-01T22:37:36.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 509750b0-4901-4d7a-b944-82bb64c4c4c5 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
70002024-11-01T22:37:36.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 509750b0-4901-4d7a-b944-82bb64c4c4c5 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
70012024-11-01T22:37:36.660ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:48876
70022024-11-01T22:37:36.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48876 req_id = 937fb500-1873-47b3-9601-a082494cb1fe roles = RoleSet { roles: {} } uri = /metrics/producers
70032024-11-01T22:37:36.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48876 req_id = 937fb500-1873-47b3-9601-a082494cb1fe resource = Database result = Ok(()) uri = /metrics/producers
70042024-11-01T22:37:36.667ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2
70052024-11-01T22:37:36.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6950 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48876 req_id = 937fb500-1873-47b3-9601-a082494cb1fe response_code = 201 uri = /metrics/producers
70062024-11-01T22:37:36.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34256 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 509750b0-4901-4d7a-b944-82bb64c4c4c5 response_code = 204 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
70072024-11-01T22:37:37.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 01e6392d-13a2-4b4c-b06a-a750d5935a16 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
70082024-11-01T22:37:37.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 01e6392d-13a2-4b4c-b06a-a750d5935a16 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
70092024-11-01T22:37:37.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 01e6392d-13a2-4b4c-b06a-a750d5935a16 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
70102024-11-01T22:37:38.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0e1d5efa-a2a7-4d5a-8089-62205a834888 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
70112024-11-01T22:37:38.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0e1d5efa-a2a7-4d5a-8089-62205a834888 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
70122024-11-01T22:37:38.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0e1d5efa-a2a7-4d5a-8089-62205a834888 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
70132024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
70142024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.851\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70152024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
70162024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
70172024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
70182024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
70192024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70202024-11-01T22:37:38.440ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:27:38.440385362 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70212024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70222024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70232024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
70242024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
70252024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70262024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
70272024-11-01T22:37:38.440ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70282024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
70292024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70302024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70312024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70322024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
70332024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70342024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70352024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
70362024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70372024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
70382024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
70392024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.47\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70402024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
70412024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70422024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
70432024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70442024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
70452024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70462024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70472024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
70482024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70492024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
70502024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
70512024-11-01T22:37:38.440ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70522024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70532024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
70542024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70552024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
70562024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
70572024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70582024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.26\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
70592024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
70602024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
70612024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70622024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
70632024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70642024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70652024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
70662024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70672024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
70682024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
70692024-11-01T22:37:38.440ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
70702024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.509\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
70712024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
70722024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
70732024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
70742024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70752024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
70762024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.01\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
70772024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70782024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
70792024-11-01T22:37:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70802024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70812024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70822024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70832024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70842024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70852024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70862024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70872024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70882024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70892024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70902024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70912024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70922024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70932024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70942024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70952024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
70962024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70972024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
70982024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70992024-11-01T22:37:38.441ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 468852325 } })
71002024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71012024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71022024-11-01T22:37:38.441ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 468945955 } })
71032024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71042024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71052024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
71062024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.33039ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
71072024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71082024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71092024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
71102024-11-01T22:37:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.218869ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
71112024-11-01T22:37:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71122024-11-01T22:37:38.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71132024-11-01T22:37:38.443ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.381665ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71142024-11-01T22:37:38.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71152024-11-01T22:37:38.444ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:27:38.440385362 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71162024-11-01T22:37:38.444ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.97189ms iteration = 13 status = {"expiration":"2024-11-01T22:27:38.440385362Z","pruned":[]}
71172024-11-01T22:37:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71182024-11-01T22:37:38.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71192024-11-01T22:37:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71202024-11-01T22:37:38.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71212024-11-01T22:37:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71222024-11-01T22:37:38.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71232024-11-01T22:37:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71242024-11-01T22:37:38.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71252024-11-01T22:37:38.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71262024-11-01T22:37:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71272024-11-01T22:37:38.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71282024-11-01T22:37:38.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71292024-11-01T22:37:38.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 476226821 } })
71302024-11-01T22:37:38.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
71312024-11-01T22:37:38.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 477087957 } })
71322024-11-01T22:37:38.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
71332024-11-01T22:37:38.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71342024-11-01T22:37:38.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71352024-11-01T22:37:38.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71362024-11-01T22:37:38.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71372024-11-01T22:37:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71382024-11-01T22:37:38.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71392024-11-01T22:37:38.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71402024-11-01T22:37:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71412024-11-01T22:37:38.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71422024-11-01T22:37:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71432024-11-01T22:37:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71442024-11-01T22:37:38.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71452024-11-01T22:37:38.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71462024-11-01T22:37:38.453ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71472024-11-01T22:37:38.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71482024-11-01T22:37:38.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71492024-11-01T22:37:38.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71502024-11-01T22:37:38.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71512024-11-01T22:37:38.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71522024-11-01T22:37:38.455ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.189315ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
71532024-11-01T22:37:38.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71542024-11-01T22:37:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71552024-11-01T22:37:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71562024-11-01T22:37:38.456ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71572024-11-01T22:37:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71582024-11-01T22:37:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71592024-11-01T22:37:38.456ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71602024-11-01T22:37:38.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71612024-11-01T22:37:38.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71622024-11-01T22:37:38.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71632024-11-01T22:37:38.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71642024-11-01T22:37:38.459ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
71652024-11-01T22:37:38.459ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71662024-11-01T22:37:38.459ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.789183ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71672024-11-01T22:37:38.459ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71682024-11-01T22:37:38.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71692024-11-01T22:37:38.461ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71702024-11-01T22:37:38.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71712024-11-01T22:37:38.461ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71722024-11-01T22:37:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71732024-11-01T22:37:38.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71742024-11-01T22:37:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71752024-11-01T22:37:38.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71762024-11-01T22:37:38.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71772024-11-01T22:37:38.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71782024-11-01T22:37:38.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71792024-11-01T22:37:38.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71802024-11-01T22:37:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71812024-11-01T22:37:38.469ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71822024-11-01T22:37:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71832024-11-01T22:37:38.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71842024-11-01T22:37:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71852024-11-01T22:37:38.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71862024-11-01T22:37:38.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71872024-11-01T22:37:38.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71882024-11-01T22:37:38.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71892024-11-01T22:37:38.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71902024-11-01T22:37:38.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71912024-11-01T22:37:38.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71922024-11-01T22:37:38.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71932024-11-01T22:37:38.478ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 505257951 } })
71942024-11-01T22:37:38.478ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
71952024-11-01T22:37:38.478ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71962024-11-01T22:37:38.478ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71972024-11-01T22:37:38.478ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71982024-11-01T22:37:38.478ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71992024-11-01T22:37:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72002024-11-01T22:37:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72012024-11-01T22:37:38.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72022024-11-01T22:37:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72032024-11-01T22:37:38.483ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 42.949246ms iteration = 6 status = {"nsuccess":5}
72042024-11-01T22:37:38.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72052024-11-01T22:37:38.486ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72062024-11-01T22:37:38.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72072024-11-01T22:37:38.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72082024-11-01T22:37:38.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72092024-11-01T22:37:38.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72102024-11-01T22:37:38.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72112024-11-01T22:37:38.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
72122024-11-01T22:37:38.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72132024-11-01T22:37:38.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72142024-11-01T22:37:38.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72152024-11-01T22:37:38.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72162024-11-01T22:37:38.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72172024-11-01T22:37:38.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72182024-11-01T22:37:38.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72192024-11-01T22:37:38.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72202024-11-01T22:37:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72212024-11-01T22:37:38.498ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72222024-11-01T22:37:38.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72232024-11-01T22:37:38.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72242024-11-01T22:37:38.501ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72252024-11-01T22:37:38.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72262024-11-01T22:37:38.505ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
72272024-11-01T22:37:38.505ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.378899ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
72282024-11-01T22:37:38.505ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
72292024-11-01T22:37:38.505ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
72302024-11-01T22:37:38.505ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
72312024-11-01T22:37:38.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72322024-11-01T22:37:38.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72332024-11-01T22:37:38.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72342024-11-01T22:37:38.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72352024-11-01T22:37:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72362024-11-01T22:37:38.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72372024-11-01T22:37:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72382024-11-01T22:37:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72392024-11-01T22:37:38.515ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
72402024-11-01T22:37:38.516ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
72412024-11-01T22:37:38.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72422024-11-01T22:37:38.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72432024-11-01T22:37:38.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72442024-11-01T22:37:38.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72452024-11-01T22:37:38.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72462024-11-01T22:37:38.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72472024-11-01T22:37:38.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.494262ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72482024-11-01T22:37:38.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72492024-11-01T22:37:38.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72502024-11-01T22:37:38.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.778151ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72512024-11-01T22:37:38.523ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72522024-11-01T22:37:38.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72532024-11-01T22:37:38.526ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72542024-11-01T22:37:38.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72552024-11-01T22:37:38.537ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72562024-11-01T22:37:38.537ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72572024-11-01T22:37:38.537ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.679045ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72582024-11-01T22:37:38.539ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72592024-11-01T22:37:38.539ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72602024-11-01T22:37:38.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72612024-11-01T22:37:38.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72622024-11-01T22:37:38.569ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
72632024-11-01T22:37:38.569ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
72642024-11-01T22:37:38.569ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
72652024-11-01T22:37:38.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72662024-11-01T22:37:38.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72672024-11-01T22:37:38.605ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72682024-11-01T22:37:38.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.668381ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72692024-11-01T22:37:38.634ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
72702024-11-01T22:37:38.634ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72712024-11-01T22:37:38.634ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a412136d-b39b-46e9-a442-30080b977b68", "content-length": "26", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
72722024-11-01T22:37:38.634ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72732024-11-01T22:37:38.637ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72742024-11-01T22:37:38.639ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 198.81952ms iteration = 29 status = {"physical_disks_added":0}
72752024-11-01T22:37:38.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
72762024-11-01T22:37:38.664ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72772024-11-01T22:37:38.664ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e1a731b-eb9f-4a99-b97e-1a5108a67c22", "content-length": "26", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
72782024-11-01T22:37:38.664ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72792024-11-01T22:37:38.667ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72802024-11-01T22:37:38.749ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
72812024-11-01T22:37:38.847ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72822024-11-01T22:37:38.896ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72832024-11-01T22:37:38.896ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "81391dd2-bfc0-49e9-b8c3-f56159ff5d05", "content-length": "1", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
72842024-11-01T22:37:38.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72852024-11-01T22:37:38.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72862024-11-01T22:37:38.922ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
72872024-11-01T22:37:38.922ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72882024-11-01T22:37:38.922ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c/state
72892024-11-01T22:37:38.922ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9840a92f-d954-4a7d-9498-e838e2109263", "content-length": "26", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
72902024-11-01T22:37:38.922ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72912024-11-01T22:37:38.922ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "5504d5cb-c261-4da7-8376-916474490bc8", "content-length": "130", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
72922024-11-01T22:37:38.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
72932024-11-01T22:37:38.925ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T22:37:36.643858296Z }, migration_in: None, migration_out: None } vmm_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
72942024-11-01T22:37:38.925ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 vmm_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T22:37:36.643858296Z }
72952024-11-01T22:37:38.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 roles = RoleSet { roles: {} } sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 vmm_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
72962024-11-01T22:37:38.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 resource = Database result = Ok(()) sled_id = 8559b5a7-3301-45c6-8f36-6213ed147b79 vmm_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c
72972024-11-01T22:37:38.929ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72982024-11-01T22:37:38.929ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e39423f4-ab58-471a-9791-2fea3a2725b1", "content-length": "811", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
72992024-11-01T22:37:38.930ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(10032583) }} sled = sock
73002024-11-01T22:37:38.930ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73012024-11-01T22:37:38.930ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73022024-11-01T22:37:38.931ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 490.98238ms iteration = 25 status = {}
73032024-11-01T22:37:38.973ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73042024-11-01T22:37:38.973ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73052024-11-01T22:37:38.973ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "19e1bb66-35bf-46f5-949b-d58859337dcf", "content-length": "585", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
73062024-11-01T22:37:38.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73072024-11-01T22:37:38.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73082024-11-01T22:37:38.976ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73092024-11-01T22:37:38.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73102024-11-01T22:37:38.977ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
73112024-11-01T22:37:38.977ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73122024-11-01T22:37:38.977ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
73132024-11-01T22:37:38.977ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 537.258291ms iteration = 14 status = {"generation":1}
73142024-11-01T22:37:38.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73152024-11-01T22:37:38.979ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 538.941173ms iteration = 25 status = null
73162024-11-01T22:37:38.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73172024-11-01T22:37:38.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73182024-11-01T22:37:38.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73192024-11-01T22:37:38.983ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
73202024-11-01T22:37:38.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73212024-11-01T22:37:38.986ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 545.774075ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
73222024-11-01T22:37:38.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
73232024-11-01T22:37:38.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73242024-11-01T22:37:38.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73252024-11-01T22:37:38.989ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 548.707148ms iteration = 25 status = 0
73262024-11-01T22:37:38.996ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 556.186055ms iteration = 25 status = {}
73272024-11-01T22:37:39.021ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73282024-11-01T22:37:39.021ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73292024-11-01T22:37:39.021ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 581.037694ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73302024-11-01T22:37:39.022ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73312024-11-01T22:37:39.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73322024-11-01T22:37:39.023ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
73332024-11-01T22:37:39.023ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
73342024-11-01T22:37:39.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73352024-11-01T22:37:39.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73362024-11-01T22:37:39.024ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73372024-11-01T22:37:39.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73382024-11-01T22:37:39.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73392024-11-01T22:37:39.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73402024-11-01T22:37:39.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73412024-11-01T22:37:39.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73422024-11-01T22:37:39.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73432024-11-01T22:37:39.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73442024-11-01T22:37:39.031ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {0e9f5571-e781-4a75-94cd-0a88bf8f6fc8: {10.151.2.176: {893251ad-179c-4c9a-a677-7fc39b345d64}, 10.151.2.175: {893251ad-179c-4c9a-a677-7fc39b345d64}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
73452024-11-01T22:37:39.031ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73462024-11-01T22:37:39.031ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f534d983-1381-4b40-aa1f-0f0e66a35e3d", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
73472024-11-01T22:37:39.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73482024-11-01T22:37:39.034ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
73492024-11-01T22:37:39.034ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73502024-11-01T22:37:39.034ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
73512024-11-01T22:37:39.034ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 593.970732ms iteration = 14 status = {"generation":2}
73522024-11-01T22:37:39.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73532024-11-01T22:37:39.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73542024-11-01T22:37:39.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73552024-11-01T22:37:39.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73562024-11-01T22:37:39.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73572024-11-01T22:37:39.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73582024-11-01T22:37:39.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73592024-11-01T22:37:39.046ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
73602024-11-01T22:37:39.046ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fa2ed844-b753-4fe5-a5e1-a1a81c1fb315", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73612024-11-01T22:37:39.046ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73622024-11-01T22:37:39.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73632024-11-01T22:37:39.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73642024-11-01T22:37:39.048ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d3867577-e4a9-4b3f-8f6c-8c4ab3974214", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73652024-11-01T22:37:39.048ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73662024-11-01T22:37:39.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73672024-11-01T22:37:39.051ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73682024-11-01T22:37:39.051ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 610.622329ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73692024-11-01T22:37:39.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73702024-11-01T22:37:39.054ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73712024-11-01T22:37:39.054ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73722024-11-01T22:37:39.054ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73732024-11-01T22:37:39.054ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ca64a9e6-d317-4ebf-b22e-de4026d0e302", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
73742024-11-01T22:37:39.056ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 616.261721ms iteration = 26 status = {}
73752024-11-01T22:37:39.059ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73762024-11-01T22:37:39.068ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
73772024-11-01T22:37:39.068ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 628.308672ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
73782024-11-01T22:37:39.105ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
73792024-11-01T22:37:39.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2abc5ac8-fff4-4f9b-bf35-5479ad8cfc21", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
73802024-11-01T22:37:39.106ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
73812024-11-01T22:37:39.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0fd5e5e7-e991-4c5d-acee-3ab6c483c6fb", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
73822024-11-01T22:37:39.107ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
73832024-11-01T22:37:39.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c531aae1-3d2b-4a58-9dbb-59feb9f903c6", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
73842024-11-01T22:37:39.110ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
73852024-11-01T22:37:39.112ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
73862024-11-01T22:37:39.112ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 672.176556ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73872024-11-01T22:37:39.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73882024-11-01T22:37:39.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73892024-11-01T22:37:39.140ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
73902024-11-01T22:37:39.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73912024-11-01T22:37:39.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73922024-11-01T22:37:39.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73932024-11-01T22:37:39.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e44e20b-78fa-43bd-a6de-bdbfd751179e", "content-length": "134", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
73942024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73952024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
73962024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73972024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73982024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73992024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74002024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74012024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74022024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74032024-11-01T22:37:39.154ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74042024-11-01T22:37:39.155ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
74052024-11-01T22:37:39.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74062024-11-01T22:37:39.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74072024-11-01T22:37:39.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74082024-11-01T22:37:39.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ebcb910-07a4-498f-b564-377e4c0bb21c", "content-length": "2", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
74092024-11-01T22:37:39.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74102024-11-01T22:37:39.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4261fcaa-0f2e-4cd0-814a-d0e677b1e1ea", "content-length": "52", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
74112024-11-01T22:37:39.157ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
74122024-11-01T22:37:39.157ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74132024-11-01T22:37:39.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 025ddb48-47b2-4817-8d04-bde6aaa9c122 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74142024-11-01T22:37:39.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 025ddb48-47b2-4817-8d04-bde6aaa9c122 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74152024-11-01T22:37:39.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 025ddb48-47b2-4817-8d04-bde6aaa9c122 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74162024-11-01T22:37:39.345ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e3e652b0-4764-4ab8-8bc4-3937af0a1dee", "date": "Fri, 01 Nov 2024 22:37:38 GMT"} })
74172024-11-01T22:37:39.345ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
74182024-11-01T22:37:39.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74192024-11-01T22:37:39.345ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c08308f-07a1-43ad-bca3-008a2388a720", "content-length": "682", "date": "Fri, 01 Nov 2024 22:37:39 GMT"} })
74202024-11-01T22:37:39.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74212024-11-01T22:37:39.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74222024-11-01T22:37:39.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74232024-11-01T22:37:39.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74242024-11-01T22:37:39.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74252024-11-01T22:37:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74262024-11-01T22:37:39.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74272024-11-01T22:37:39.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74282024-11-01T22:37:39.362ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 921.817862ms iteration = 25 status = {}
74292024-11-01T22:37:40.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1bd65d82-fd08-451f-94cb-86c0f04b7c95 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74302024-11-01T22:37:40.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1bd65d82-fd08-451f-94cb-86c0f04b7c95 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74312024-11-01T22:37:40.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1bd65d82-fd08-451f-94cb-86c0f04b7c95 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74322024-11-01T22:37:41.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 05152a18-273f-41c6-bd1b-85b5c269d2ef roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74332024-11-01T22:37:41.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 05152a18-273f-41c6-bd1b-85b5c269d2ef resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74342024-11-01T22:37:41.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 05152a18-273f-41c6-bd1b-85b5c269d2ef response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74352024-11-01T22:37:42.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e40e1554-cf60-4981-8a6e-38574cfc5d6c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74362024-11-01T22:37:42.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e40e1554-cf60-4981-8a6e-38574cfc5d6c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74372024-11-01T22:37:42.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e40e1554-cf60-4981-8a6e-38574cfc5d6c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74382024-11-01T22:37:43.199ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3974 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = c4032f44-0a27-41a8-9783-568134e3682f response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
74392024-11-01T22:37:43.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cacd600b-08d8-4ba9-9d02-667d87fc397e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74402024-11-01T22:37:43.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cacd600b-08d8-4ba9-9d02-667d87fc397e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74412024-11-01T22:37:43.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cacd600b-08d8-4ba9-9d02-667d87fc397e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74422024-11-01T22:37:44.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f6578fc-8778-445c-b7f3-275b23cdfba6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74432024-11-01T22:37:44.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f6578fc-8778-445c-b7f3-275b23cdfba6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74442024-11-01T22:37:44.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6f6578fc-8778-445c-b7f3-275b23cdfba6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74452024-11-01T22:37:45.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ba311fb-66f8-48a7-86b7-9cdded4e59a6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74462024-11-01T22:37:45.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ba311fb-66f8-48a7-86b7-9cdded4e59a6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74472024-11-01T22:37:45.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ba311fb-66f8-48a7-86b7-9cdded4e59a6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74482024-11-01T22:37:46.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 86f9af12-51d5-4e59-81ee-c8ed2f7a06ff roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74492024-11-01T22:37:46.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 86f9af12-51d5-4e59-81ee-c8ed2f7a06ff resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74502024-11-01T22:37:46.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 86f9af12-51d5-4e59-81ee-c8ed2f7a06ff response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74512024-11-01T22:37:46.586ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bd118ce-01d8-46c3-802f-5d2460213432 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T22:37:46.586558330Z }
74522024-11-01T22:37:46.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bd118ce-01d8-46c3-802f-5d2460213432 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74532024-11-01T22:37:46.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bd118ce-01d8-46c3-802f-5d2460213432 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74542024-11-01T22:37:46.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11880 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bd118ce-01d8-46c3-802f-5d2460213432 response_code = 204 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74552024-11-01T22:37:47.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 939354f1-96c0-48b5-a3af-1a29e3da74e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
74562024-11-01T22:37:47.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 939354f1-96c0-48b5-a3af-1a29e3da74e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
74572024-11-01T22:37:47.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 939354f1-96c0-48b5-a3af-1a29e3da74e2 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
74582024-11-01T22:37:47.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 31d58971-2138-45ae-abd3-37e7e45fccb6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
74592024-11-01T22:37:47.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 31d58971-2138-45ae-abd3-37e7e45fccb6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
74602024-11-01T22:37:47.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 31d58971-2138-45ae-abd3-37e7e45fccb6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
74612024-11-01T22:37:47.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e5a7a536-0607-4f7d-a9f2-73df89c57e23 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74622024-11-01T22:37:47.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e5a7a536-0607-4f7d-a9f2-73df89c57e23 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74632024-11-01T22:37:47.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e5a7a536-0607-4f7d-a9f2-73df89c57e23 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74642024-11-01T22:37:48.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9a2c8415-eef0-441a-9ec9-fa60276deff1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
74652024-11-01T22:37:48.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9a2c8415-eef0-441a-9ec9-fa60276deff1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
74662024-11-01T22:37:48.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 9a2c8415-eef0-441a-9ec9-fa60276deff1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
74672024-11-01T22:37:48.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
74682024-11-01T22:37:48.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
74692024-11-01T22:37:48.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74702024-11-01T22:37:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74712024-11-01T22:37:48.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b3a2687-f030-40da-af47-f6a7edfa5419 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74722024-11-01T22:37:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74732024-11-01T22:37:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74742024-11-01T22:37:48.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b3a2687-f030-40da-af47-f6a7edfa5419 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74752024-11-01T22:37:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74762024-11-01T22:37:48.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b3a2687-f030-40da-af47-f6a7edfa5419 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
74772024-11-01T22:37:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74782024-11-01T22:37:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74792024-11-01T22:37:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74802024-11-01T22:37:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74812024-11-01T22:37:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74822024-11-01T22:37:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74832024-11-01T22:37:48.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
74842024-11-01T22:37:48.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74852024-11-01T22:37:48.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74862024-11-01T22:37:48.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
74872024-11-01T22:37:48.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.581806ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
74882024-11-01T22:37:48.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74892024-11-01T22:37:48.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74902024-11-01T22:37:48.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.054464ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74912024-11-01T22:37:49.027ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T22:37:49.026950347Z }
74922024-11-01T22:37:49.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74932024-11-01T22:37:49.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74942024-11-01T22:37:49.038ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_needs_update = true
74952024-11-01T22:37:49.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74962024-11-01T22:37:49.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74972024-11-01T22:37:49.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74982024-11-01T22:37:49.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
74992024-11-01T22:37:49.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75002024-11-01T22:37:49.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75012024-11-01T22:37:49.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75022024-11-01T22:37:49.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75032024-11-01T22:37:49.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75042024-11-01T22:37:49.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75052024-11-01T22:37:49.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75062024-11-01T22:37:49.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75072024-11-01T22:37:49.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75082024-11-01T22:37:49.055ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, lookup_type: ById(42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5) }, key: 9c656347-b114-4a0a-996c-a291e53e2e71, lookup_type: ById(9c656347-b114-4a0a-996c-a291e53e2e71) }, key: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2, lookup_type: ById(f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2) } result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75092024-11-01T22:37:49.055ZINFOnexus (dropshot_internal): starting update saga for f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T22:37:49.026950347Z }
75102024-11-01T22:37:49.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28488 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 response_code = 204 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75112024-11-01T22:37:49.056ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fa418a7d-ff97-4019-b6d2-ffa934630e30 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T22:37:49.026950347Z }
75122024-11-01T22:37:49.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fa418a7d-ff97-4019-b6d2-ffa934630e30 roles = RoleSet { roles: {} } uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75132024-11-01T22:37:49.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fa418a7d-ff97-4019-b6d2-ffa934630e30 resource = Database result = Ok(()) uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75142024-11-01T22:37:49.058ZDEBGnexus (dropshot_internal): preparing instance-update saga for f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 26a85ee4-c361-4d7b-bcf1-d08d5bb496c7 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75152024-11-01T22:37:49.058ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update
75162024-11-01T22:37:49.058ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2","lookup_type":{"ById":"f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2"},"parent":{"key":"9c656347-b114-4a0a-996c-a291e53e2e71","lookup_type":{"ById":"9c656347-b114-4a0a-996c-a291e53e2e71"},"parent":{"key":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","lookup_type":{"ById":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75172024-11-01T22:37:49.058ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update
75182024-11-01T22:37:49.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33552 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fa418a7d-ff97-4019-b6d2-ffa934630e30 response_code = 204 uri = /vmms/4faf19ea-eea1-4ef6-8607-11b243720a1c
75192024-11-01T22:37:49.093ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update
75202024-11-01T22:37:49.093ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75212024-11-01T22:37:49.093ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75222024-11-01T22:37:49.093ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
75232024-11-01T22:37:49.099ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75242024-11-01T22:37:49.099ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
75252024-11-01T22:37:49.104ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75262024-11-01T22:37:49.104ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
75272024-11-01T22:37:49.107ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75282024-11-01T22:37:49.107ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bc7303d7-3df6-489e-8ed1-8511de503410")) node_id = 0 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
75292024-11-01T22:37:49.111ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75302024-11-01T22:37:49.111ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
75312024-11-01T22:37:49.122ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update
75322024-11-01T22:37:49.122ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75332024-11-01T22:37:49.122ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75342024-11-01T22:37:49.124ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75352024-11-01T22:37:49.124ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75362024-11-01T22:37:49.126ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75372024-11-01T22:37:49.126ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75382024-11-01T22:37:49.128ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75392024-11-01T22:37:49.128ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75402024-11-01T22:37:49.129ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75412024-11-01T22:37:49.130ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75422024-11-01T22:37:49.131ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75432024-11-01T22:37:49.131ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75442024-11-01T22:37:49.132ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75452024-11-01T22:37:49.135ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, lookup_type: ById(42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5) }, key: 9c656347-b114-4a0a-996c-a291e53e2e71, lookup_type: ById(9c656347-b114-4a0a-996c-a291e53e2e71) }, key: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2, lookup_type: ById(f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2) } result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75462024-11-01T22:37:49.135ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance updater_id = bc7303d7-3df6-489e-8ed1-8511de503410
75472024-11-01T22:37:49.135ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75482024-11-01T22:37:49.136ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75492024-11-01T22:37:49.150ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance updater_id = bc7303d7-3df6-489e-8ed1-8511de503410
75502024-11-01T22:37:49.150ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75512024-11-01T22:37:49.150ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance
75522024-11-01T22:37:49.155ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 locked_gen = Generation(Generation(2)) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = LockInstance updater_id = bc7303d7-3df6-489e-8ed1-8511de503410
75532024-11-01T22:37:49.155ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75542024-11-01T22:37:49.155ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bc7303d7-3df6-489e-8ed1-8511de503410")}) node_id = 1 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
75552024-11-01T22:37:49.160ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75562024-11-01T22:37:49.160ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
75572024-11-01T22:37:49.167ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75582024-11-01T22:37:49.167ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75592024-11-01T22:37:49.171ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75602024-11-01T22:37:49.171ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75612024-11-01T22:37:49.172ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75622024-11-01T22:37:49.172ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75632024-11-01T22:37:49.174ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75642024-11-01T22:37:49.177ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, lookup_type: ById(42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5) }, key: 9c656347-b114-4a0a-996c-a291e53e2e71, lookup_type: ById(9c656347-b114-4a0a-996c-a291e53e2e71) }, key: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2, lookup_type: ById(f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2) } result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75652024-11-01T22:37:49.177ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75662024-11-01T22:37:49.177ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75672024-11-01T22:37:49.185ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 4faf19ea-eea1-4ef6-8607-11b243720a1c, time_created: 2024-11-01T22:37:28.185952Z, time_deleted: None, instance_id: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2, sled_id: 8559b5a7-3301-45c6-8f36-6213ed147b79, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-01T22:37:49.026950Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-01T22:37:25.865162Z, gen: Generation(Generation(3)), propolis_id: Some(4faf19ea-eea1-4ef6-8607-11b243720a1c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(4faf19ea-eea1-4ef6-8607-11b243720a1c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-01T22:37:49.185474112Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
75682024-11-01T22:37:49.185ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
75692024-11-01T22:37:49.185ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"4faf19ea-eea1-4ef6-8607-11b243720a1c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2","lookup_type":{"ById":"f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2"},"parent":{"key":"9c656347-b114-4a0a-996c-a291e53e2e71","lookup_type":{"ById":"9c656347-b114-4a0a-996c-a291e53e2e71"},"parent":{"key":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","lookup_type":{"ById":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"bc7303d7-3df6-489e-8ed1-8511de503410"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"9c656347-b114-4a0a-996c-a291e53e2e71","ram_diff":1073741824},"destroy_active_vmm":"4faf19ea-eea1-4ef6-8607-11b243720a1c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-01T22:37:49.185474112Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75702024-11-01T22:37:49.185ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
75712024-11-01T22:37:49.193ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
75722024-11-01T22:37:49.193ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75732024-11-01T22:37:49.193ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75742024-11-01T22:37:49.193ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75752024-11-01T22:37:49.199ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75762024-11-01T22:37:49.199ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75772024-11-01T22:37:49.204ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75782024-11-01T22:37:49.204ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75792024-11-01T22:37:49.208ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75802024-11-01T22:37:49.208ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("96333cc3-630e-4f7d-b31a-3b7e89f25370")) node_id = 0 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75812024-11-01T22:37:49.212ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75822024-11-01T22:37:49.212ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75832024-11-01T22:37:49.216ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 parent_lock = UpdaterLock { updater_id: bc7303d7-3df6-489e-8ed1-8511de503410, locked_gen: Generation(Generation(2)) } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
75842024-11-01T22:37:49.218ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = BecomeUpdater
75852024-11-01T22:37:49.218ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = BecomeUpdater
75862024-11-01T22:37:49.230ZDEBGnexus (SagaExecutor): inherited lock from bc7303d7-3df6-489e-8ed1-8511de503410 to 96333cc3-630e-4f7d-b31a-3b7e89f25370 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = bc7303d7-3df6-489e-8ed1-8511de503410 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = BecomeUpdater updater_id = 96333cc3-630e-4f7d-b31a-3b7e89f25370
75872024-11-01T22:37:49.230ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
75882024-11-01T22:37:49.230ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75892024-11-01T22:37:49.230ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("96333cc3-630e-4f7d-b31a-3b7e89f25370")}) node_id = 1 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75902024-11-01T22:37:49.234ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75912024-11-01T22:37:49.234ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75922024-11-01T22:37:49.237ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75932024-11-01T22:37:49.237ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75942024-11-01T22:37:49.241ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
75952024-11-01T22:37:49.241ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
75962024-11-01T22:37:49.245ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
75972024-11-01T22:37:49.248ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2
75982024-11-01T22:37:49.250ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UpdateNetworkConfig
75992024-11-01T22:37:49.250ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UpdateNetworkConfig
76002024-11-01T22:37:49.253ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UpdateNetworkConfig
76012024-11-01T22:37:49.253ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UpdateNetworkConfig
76022024-11-01T22:37:49.260ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
76032024-11-01T22:37:49.260ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UpdateNetworkConfig
76042024-11-01T22:37:49.260ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UpdateNetworkConfig
76052024-11-01T22:37:49.263ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
76062024-11-01T22:37:49.265ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
76072024-11-01T22:37:49.265ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
76082024-11-01T22:37:49.266ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
76092024-11-01T22:37:49.268ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
76102024-11-01T22:37:49.268ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
76112024-11-01T22:37:49.268ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
76122024-11-01T22:37:49.272ZDEBGnexus: notifying dendrite of updates instance_id = Some(f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 (instance)) switch = switch0
76132024-11-01T22:37:49.273ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1589, tv_nsec: 300671863 } })
76142024-11-01T22:37:49.273ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
76152024-11-01T22:37:49.304ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
76162024-11-01T22:37:49.304ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76172024-11-01T22:37:49.305ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c660dfe3-49dc-4927-8b5d-cf87a8dabc03", "content-length": "26", "date": "Fri, 01 Nov 2024 22:37:49 GMT"} })
76182024-11-01T22:37:49.305ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76192024-11-01T22:37:49.305ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76202024-11-01T22:37:49.336ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
76212024-11-01T22:37:49.336ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce4f6b93-ef34-4a82-b1ec-f9faf71cd230", "content-length": "4", "date": "Fri, 01 Nov 2024 22:37:48 GMT"} })
76222024-11-01T22:37:49.336ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76232024-11-01T22:37:49.336ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76242024-11-01T22:37:49.343ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76252024-11-01T22:37:49.343ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76262024-11-01T22:37:49.350ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
76272024-11-01T22:37:49.351ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
76282024-11-01T22:37:49.366ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-01T22:37:49.353663Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, time_modified: Some(2024-11-01T22:37:49.353663Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9c656347-b114-4a0a-996c-a291e53e2e71, time_modified: Some(2024-11-01T22:37:49.353663Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76292024-11-01T22:37:49.366ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76302024-11-01T22:37:49.366ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76312024-11-01T22:37:49.369ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76322024-11-01T22:37:49.369ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76332024-11-01T22:37:49.373ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76342024-11-01T22:37:49.373ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UnassignOximeterProducer
76352024-11-01T22:37:49.373ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UnassignOximeterProducer
76362024-11-01T22:37:49.378ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 producer_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76372024-11-01T22:37:49.378ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UnassignOximeterProducer
76382024-11-01T22:37:49.378ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = UnassignOximeterProducer
76392024-11-01T22:37:49.417ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76402024-11-01T22:37:49.419ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2
76412024-11-01T22:37:49.438ZDEBGnexus (SagaExecutor): client response oximeter-collector = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2", status: 204, headers: {"x-request-id": "2be9e1c2-8cff-4003-b2b9-453cf0811f75", "date": "Fri, 01 Nov 2024 22:37:49 GMT"} }) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76422024-11-01T22:37:49.438ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 producer_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76432024-11-01T22:37:49.440ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76442024-11-01T22:37:49.440ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76452024-11-01T22:37:49.443ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76462024-11-01T22:37:49.443ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76472024-11-01T22:37:49.448ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 lock = UpdaterLock { updater_id: 96333cc3-630e-4f7d-b31a-3b7e89f25370, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-01T22:37:49.185474112Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76482024-11-01T22:37:49.448ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = CommitInstanceUpdates
76492024-11-01T22:37:49.449ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = CommitInstanceUpdates
76502024-11-01T22:37:49.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 40d48c90-c1f4-4e8f-a933-d5c5d4be65be roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
76512024-11-01T22:37:49.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 40d48c90-c1f4-4e8f-a933-d5c5d4be65be resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
76522024-11-01T22:37:49.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 40d48c90-c1f4-4e8f-a933-d5c5d4be65be response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
76532024-11-01T22:37:49.485ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 new_runtime = InstanceRuntimeState { time_updated: 2024-11-01T22:37:49.185474112Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76542024-11-01T22:37:49.485ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76552024-11-01T22:37:49.485ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76562024-11-01T22:37:49.485ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
76572024-11-01T22:37:49.485ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
76582024-11-01T22:37:49.485ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76592024-11-01T22:37:49.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76602024-11-01T22:37:49.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76612024-11-01T22:37:49.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76622024-11-01T22:37:49.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76632024-11-01T22:37:49.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76642024-11-01T22:37:49.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76652024-11-01T22:37:49.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76662024-11-01T22:37:49.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76672024-11-01T22:37:49.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76682024-11-01T22:37:49.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76692024-11-01T22:37:49.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76702024-11-01T22:37:49.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76712024-11-01T22:37:49.493ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76722024-11-01T22:37:49.493ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76732024-11-01T22:37:49.504ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76742024-11-01T22:37:49.504ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("4faf19ea-eea1-4ef6-8607-11b243720a1c")}) node_id = 7 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76752024-11-01T22:37:49.508ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76762024-11-01T22:37:49.508ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76772024-11-01T22:37:49.513ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76782024-11-01T22:37:49.513ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76792024-11-01T22:37:49.518ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76802024-11-01T22:37:49.518ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76812024-11-01T22:37:49.525ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76822024-11-01T22:37:49.525ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ReleaseSledResources
76832024-11-01T22:37:49.525ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ReleaseSledResources
76842024-11-01T22:37:49.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76852024-11-01T22:37:49.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76862024-11-01T22:37:49.531ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76872024-11-01T22:37:49.531ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76882024-11-01T22:37:49.536ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76892024-11-01T22:37:49.536ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76902024-11-01T22:37:49.540ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 propolis_id = 4faf19ea-eea1-4ef6-8607-11b243720a1c saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
76912024-11-01T22:37:49.540ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = MarkVmmDeleted
76922024-11-01T22:37:49.540ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = MarkVmmDeleted
76932024-11-01T22:37:49.576ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76942024-11-01T22:37:49.576ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76952024-11-01T22:37:49.581ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
76962024-11-01T22:37:49.581ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
76972024-11-01T22:37:49.584ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76982024-11-01T22:37:49.584ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76992024-11-01T22:37:49.584ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77002024-11-01T22:37:49.584ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
77012024-11-01T22:37:49.584ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8bd4497-f7e1-41cf-96d9-794108ac48a4", "content-length": "372", "date": "Fri, 01 Nov 2024 22:37:49 GMT"} })
77022024-11-01T22:37:49.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77032024-11-01T22:37:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77042024-11-01T22:37:49.587ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77052024-11-01T22:37:49.587ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
77062024-11-01T22:37:49.591ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77072024-11-01T22:37:49.591ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77082024-11-01T22:37:49.592ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77092024-11-01T22:37:49.593ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77102024-11-01T22:37:49.594ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77112024-11-01T22:37:49.594ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77122024-11-01T22:37:49.596ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77132024-11-01T22:37:49.599ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, lookup_type: ById(42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5) }, key: 9c656347-b114-4a0a-996c-a291e53e2e71, lookup_type: ById(9c656347-b114-4a0a-996c-a291e53e2e71) }, key: f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2, lookup_type: ById(f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2) } result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77142024-11-01T22:37:49.599ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77152024-11-01T22:37:49.599ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_node = ChainSuccessorSaga
77162024-11-01T22:37:49.605ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update
77172024-11-01T22:37:49.605ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77182024-11-01T22:37:49.605ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
77192024-11-01T22:37:49.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
77202024-11-01T22:37:49.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77212024-11-01T22:37:49.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77222024-11-01T22:37:49.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77232024-11-01T22:37:49.608ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77242024-11-01T22:37:49.608ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77252024-11-01T22:37:49.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77262024-11-01T22:37:49.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77272024-11-01T22:37:49.608ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77282024-11-01T22:37:49.608ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
77292024-11-01T22:37:49.612ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77302024-11-01T22:37:49.612ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
77312024-11-01T22:37:49.616ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77322024-11-01T22:37:49.616ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ee5f6d2b-263b-49db-a097-491252e65d49
77332024-11-01T22:37:49.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77342024-11-01T22:37:49.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77352024-11-01T22:37:49.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77362024-11-01T22:37:49.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77372024-11-01T22:37:49.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77382024-11-01T22:37:49.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77392024-11-01T22:37:49.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77402024-11-01T22:37:49.629ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
77412024-11-01T22:37:49.629ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77422024-11-01T22:37:49.629ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35f2bb7e-a5d8-420c-b299-591e62b54f67", "date": "Fri, 01 Nov 2024 22:37:49 GMT"} })
77432024-11-01T22:37:49.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77442024-11-01T22:37:49.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77452024-11-01T22:37:49.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77462024-11-01T22:37:49.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77472024-11-01T22:37:49.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77482024-11-01T22:37:49.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77492024-11-01T22:37:49.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77502024-11-01T22:37:49.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77512024-11-01T22:37:49.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77522024-11-01T22:37:49.637ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77532024-11-01T22:37:49.637ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77542024-11-01T22:37:49.638ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "70f4d01c-b72f-41ac-a3d5-75a4356fb30a", "date": "Fri, 01 Nov 2024 22:37:49 GMT"} })
77552024-11-01T22:37:49.639ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77562024-11-01T22:37:49.639ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77572024-11-01T22:37:49.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77582024-11-01T22:37:49.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77592024-11-01T22:37:49.640ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 154.378922ms iteration = 27 status = {}
77602024-11-01T22:37:49.641ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77612024-11-01T22:37:49.641ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77622024-11-01T22:37:49.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 36.668359ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77632024-11-01T22:37:49.671ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77642024-11-01T22:37:49.671ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 saga_name = instance-update saga_result = SagaResult { saga_id: ee5f6d2b-263b-49db-a097-491252e65d49, saga_log: SagaLog { saga_id: ee5f6d2b-263b-49db-a097-491252e65d49, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("96333cc3-630e-4f7d-b31a-3b7e89f25370")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("96333cc3-630e-4f7d-b31a-3b7e89f25370")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("4faf19ea-eea1-4ef6-8607-11b243720a1c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("4faf19ea-eea1-4ef6-8607-11b243720a1c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("96333cc3-630e-4f7d-b31a-3b7e89f25370"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("96333cc3-630e-4f7d-b31a-3b7e89f25370")}} }) }
77652024-11-01T22:37:49.671ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = ee5f6d2b-263b-49db-a097-491252e65d49 instance_id = f05ba03a-7ae1-46ab-b40e-143a3b8fc2b2 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update
77662024-11-01T22:37:49.671ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77672024-11-01T22:37:49.671ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
77682024-11-01T22:37:49.677ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77692024-11-01T22:37:49.677ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
77702024-11-01T22:37:49.680ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77712024-11-01T22:37:49.680ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
77722024-11-01T22:37:49.684ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77732024-11-01T22:37:49.684ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d
77742024-11-01T22:37:49.722ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77752024-11-01T22:37:49.722ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dc5582f-f319-4849-8eb9-25c4aa0d2d44", "content-length": "691", "date": "Fri, 01 Nov 2024 22:37:49 GMT"} })
77762024-11-01T22:37:49.722ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77772024-11-01T22:37:49.723ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77782024-11-01T22:37:49.723ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77792024-11-01T22:37:49.724ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 238.905545ms iteration = 26 status = {}
77802024-11-01T22:37:49.745ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update sec_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
77812024-11-01T22:37:49.745ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = fd255559-f455-42ea-b3c7-6f3bb7c2f09d saga_name = start-instance-update saga_result = SagaResult { saga_id: fd255559-f455-42ea-b3c7-6f3bb7c2f09d, saga_log: SagaLog { saga_id: fd255559-f455-42ea-b3c7-6f3bb7c2f09d, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("bc7303d7-3df6-489e-8ed1-8511de503410")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bc7303d7-3df6-489e-8ed1-8511de503410")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("bc7303d7-3df6-489e-8ed1-8511de503410"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("bc7303d7-3df6-489e-8ed1-8511de503410")}} }) }
77822024-11-01T22:37:50.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = c5a70c69-a447-4042-bbf2-6223830d8281 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
77832024-11-01T22:37:50.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = c5a70c69-a447-4042-bbf2-6223830d8281 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
77842024-11-01T22:37:50.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = c5a70c69-a447-4042-bbf2-6223830d8281 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
77852024-11-01T22:37:50.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b48d3e0f-6daf-4555-846f-2347b1385a76 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77862024-11-01T22:37:50.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b48d3e0f-6daf-4555-846f-2347b1385a76 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77872024-11-01T22:37:50.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b48d3e0f-6daf-4555-846f-2347b1385a76 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77882024-11-01T22:37:51.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b9318649-bf89-4272-ab0d-4e426569b3dc roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77892024-11-01T22:37:51.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b9318649-bf89-4272-ab0d-4e426569b3dc resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77902024-11-01T22:37:51.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b9318649-bf89-4272-ab0d-4e426569b3dc response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77912024-11-01T22:37:52.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d6e76bdb-a396-4872-9945-04e950420ecf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77922024-11-01T22:37:52.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d6e76bdb-a396-4872-9945-04e950420ecf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77932024-11-01T22:37:52.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d6e76bdb-a396-4872-9945-04e950420ecf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77942024-11-01T22:37:53.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 328229c7-e135-4b57-9184-cf85503d3107 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77952024-11-01T22:37:53.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 328229c7-e135-4b57-9184-cf85503d3107 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77962024-11-01T22:37:53.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 328229c7-e135-4b57-9184-cf85503d3107 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77972024-11-01T22:37:54.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 76924f18-d86e-465a-8229-588859e9a454 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77982024-11-01T22:37:54.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 76924f18-d86e-465a-8229-588859e9a454 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
77992024-11-01T22:37:54.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 76924f18-d86e-465a-8229-588859e9a454 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78002024-11-01T22:37:55.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 15bda0fa-1da1-4924-87d8-37a3066e1d17 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78012024-11-01T22:37:55.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 15bda0fa-1da1-4924-87d8-37a3066e1d17 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78022024-11-01T22:37:55.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 15bda0fa-1da1-4924-87d8-37a3066e1d17 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78032024-11-01T22:37:56.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bb88411-cfe2-4929-a142-d487aaa6706c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78042024-11-01T22:37:56.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bb88411-cfe2-4929-a142-d487aaa6706c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78052024-11-01T22:37:56.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9bb88411-cfe2-4929-a142-d487aaa6706c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78062024-11-01T22:37:57.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f2c970c0-957f-439e-befe-054ae3fabc64 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78072024-11-01T22:37:57.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f2c970c0-957f-439e-befe-054ae3fabc64 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78082024-11-01T22:37:57.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f2c970c0-957f-439e-befe-054ae3fabc64 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78092024-11-01T22:37:58.197ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1500 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 43898024-3ba6-4d13-8747-cac2f2f9b9cc response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
78102024-11-01T22:37:58.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
78112024-11-01T22:37:58.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78122024-11-01T22:37:58.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
78132024-11-01T22:37:58.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78142024-11-01T22:37:58.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78152024-11-01T22:37:58.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78162024-11-01T22:37:58.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78172024-11-01T22:37:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78182024-11-01T22:37:58.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78192024-11-01T22:37:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78202024-11-01T22:37:58.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78212024-11-01T22:37:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78222024-11-01T22:37:58.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78232024-11-01T22:37:58.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
78242024-11-01T22:37:58.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78252024-11-01T22:37:58.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78262024-11-01T22:37:58.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
78272024-11-01T22:37:58.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.912102ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
78282024-11-01T22:37:58.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78292024-11-01T22:37:58.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78302024-11-01T22:37:58.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.682061ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78312024-11-01T22:37:58.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bd8cbea7-7c67-400b-bf7e-6d17ba3d5149 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78322024-11-01T22:37:58.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bd8cbea7-7c67-400b-bf7e-6d17ba3d5149 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78332024-11-01T22:37:58.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bd8cbea7-7c67-400b-bf7e-6d17ba3d5149 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78342024-11-01T22:37:59.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ee63393c-3cf3-4f61-afea-160aa403ea84 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78352024-11-01T22:37:59.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ee63393c-3cf3-4f61-afea-160aa403ea84 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78362024-11-01T22:37:59.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ee63393c-3cf3-4f61-afea-160aa403ea84 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78372024-11-01T22:38:00.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a547b240-b798-403a-8239-1ad86dca8c9c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78382024-11-01T22:38:00.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a547b240-b798-403a-8239-1ad86dca8c9c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78392024-11-01T22:38:00.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a547b240-b798-403a-8239-1ad86dca8c9c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78402024-11-01T22:38:01.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 205dfa76-c7ce-4b70-a1cd-9c0ad9ba812d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78412024-11-01T22:38:01.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 205dfa76-c7ce-4b70-a1cd-9c0ad9ba812d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78422024-11-01T22:38:01.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 205dfa76-c7ce-4b70-a1cd-9c0ad9ba812d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78432024-11-01T22:38:02.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 13b08597-effe-4908-84ed-f02be6622fd8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78442024-11-01T22:38:02.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 13b08597-effe-4908-84ed-f02be6622fd8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78452024-11-01T22:38:02.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 13b08597-effe-4908-84ed-f02be6622fd8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78462024-11-01T22:38:03.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = dfa75774-b310-4657-b219-67c23ad29194 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
78472024-11-01T22:38:03.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = dfa75774-b310-4657-b219-67c23ad29194 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
78482024-11-01T22:38:03.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = dfa75774-b310-4657-b219-67c23ad29194 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
78492024-11-01T22:38:03.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = f68685b6-9abb-4bd0-9c19-2d93769a8d76 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
78502024-11-01T22:38:03.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = f68685b6-9abb-4bd0-9c19-2d93769a8d76 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
78512024-11-01T22:38:03.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = f68685b6-9abb-4bd0-9c19-2d93769a8d76 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
78522024-11-01T22:38:03.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58bc84a8-79a0-4a22-8429-466330640deb roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78532024-11-01T22:38:03.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58bc84a8-79a0-4a22-8429-466330640deb resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78542024-11-01T22:38:03.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 58bc84a8-79a0-4a22-8429-466330640deb response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78552024-11-01T22:38:04.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00051fad-4bb8-42a9-93c5-e8385f82cdf0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78562024-11-01T22:38:04.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00051fad-4bb8-42a9-93c5-e8385f82cdf0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78572024-11-01T22:38:04.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00051fad-4bb8-42a9-93c5-e8385f82cdf0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78582024-11-01T22:38:05.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 61d64463-b9b5-4890-81cf-4bd196b13bf6 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78592024-11-01T22:38:05.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 61d64463-b9b5-4890-81cf-4bd196b13bf6 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78602024-11-01T22:38:05.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 61d64463-b9b5-4890-81cf-4bd196b13bf6 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78612024-11-01T22:38:06.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6ea8a34b-0ca7-4467-80e9-8a3b535d12f2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78622024-11-01T22:38:06.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6ea8a34b-0ca7-4467-80e9-8a3b535d12f2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78632024-11-01T22:38:06.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6ea8a34b-0ca7-4467-80e9-8a3b535d12f2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78642024-11-01T22:38:07.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e52a43dd-e070-4265-91d6-6e441af92842 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78652024-11-01T22:38:07.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e52a43dd-e070-4265-91d6-6e441af92842 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78662024-11-01T22:38:07.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e52a43dd-e070-4265-91d6-6e441af92842 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
78672024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
78682024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 25.74\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78692024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
78702024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
78712024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
78722024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78732024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78742024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78752024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
78762024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.04\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
78772024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
78782024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78792024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
78802024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
78812024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78822024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
78832024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
78842024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
78852024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78862024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78872024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78882024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
78892024-11-01T22:38:08.441ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78902024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78912024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
78922024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
78932024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.58\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78942024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78952024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
78962024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78972024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
78982024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78992024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79002024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
79012024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.24\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
79022024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79032024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79042024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79052024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79062024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79072024-11-01T22:38:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79082024-11-01T22:38:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79092024-11-01T22:38:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79102024-11-01T22:38:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79112024-11-01T22:38:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79122024-11-01T22:38:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79132024-11-01T22:38:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79142024-11-01T22:38:08.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79152024-11-01T22:38:08.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79162024-11-01T22:38:08.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.672128ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79172024-11-01T22:38:08.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79182024-11-01T22:38:08.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79192024-11-01T22:38:08.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79202024-11-01T22:38:08.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79212024-11-01T22:38:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79222024-11-01T22:38:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79232024-11-01T22:38:08.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79242024-11-01T22:38:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79252024-11-01T22:38:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79262024-11-01T22:38:08.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79272024-11-01T22:38:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79282024-11-01T22:38:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79292024-11-01T22:38:08.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79302024-11-01T22:38:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79312024-11-01T22:38:08.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 475446895 } })
79322024-11-01T22:38:08.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
79332024-11-01T22:38:08.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 476470663 } })
79342024-11-01T22:38:08.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
79352024-11-01T22:38:08.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79362024-11-01T22:38:08.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79372024-11-01T22:38:08.450ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79382024-11-01T22:38:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79392024-11-01T22:38:08.451ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79402024-11-01T22:38:08.451ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79412024-11-01T22:38:08.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79422024-11-01T22:38:08.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79432024-11-01T22:38:08.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79442024-11-01T22:38:08.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79452024-11-01T22:38:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79462024-11-01T22:38:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79472024-11-01T22:38:08.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79482024-11-01T22:38:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79492024-11-01T22:38:08.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79502024-11-01T22:38:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79512024-11-01T22:38:08.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.027726ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79522024-11-01T22:38:08.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 483937780 } })
79532024-11-01T22:38:08.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
79542024-11-01T22:38:08.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79552024-11-01T22:38:08.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79562024-11-01T22:38:08.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79572024-11-01T22:38:08.458ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79582024-11-01T22:38:08.458ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.979649ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
79592024-11-01T22:38:08.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79602024-11-01T22:38:08.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79612024-11-01T22:38:08.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79622024-11-01T22:38:08.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79632024-11-01T22:38:08.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79642024-11-01T22:38:08.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79652024-11-01T22:38:08.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79662024-11-01T22:38:08.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79672024-11-01T22:38:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79682024-11-01T22:38:08.481ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79692024-11-01T22:38:08.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79702024-11-01T22:38:08.482ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.093942ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79712024-11-01T22:38:08.486ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79722024-11-01T22:38:08.486ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79732024-11-01T22:38:08.486ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 45.383205ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79742024-11-01T22:38:08.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79752024-11-01T22:38:08.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79762024-11-01T22:38:08.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79772024-11-01T22:38:08.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79782024-11-01T22:38:08.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79792024-11-01T22:38:08.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79802024-11-01T22:38:08.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79812024-11-01T22:38:08.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79822024-11-01T22:38:08.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79832024-11-01T22:38:08.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79842024-11-01T22:38:08.506ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 65.009714ms iteration = 30 status = {"physical_disks_added":0}
79852024-11-01T22:38:08.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79862024-11-01T22:38:08.518ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
79872024-11-01T22:38:08.518ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79882024-11-01T22:38:08.518ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4326e2d3-d801-4c45-8539-f9e463b9fb1b", "content-length": "26", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
79892024-11-01T22:38:08.518ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79902024-11-01T22:38:08.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
79912024-11-01T22:38:08.520ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79922024-11-01T22:38:08.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79932024-11-01T22:38:08.521ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8439604d-0af3-451b-9f5f-0f6cae99f4f6", "content-length": "26", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
79942024-11-01T22:38:08.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79952024-11-01T22:38:08.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
79962024-11-01T22:38:08.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79972024-11-01T22:38:08.521ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79982024-11-01T22:38:08.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79992024-11-01T22:38:08.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80002024-11-01T22:38:08.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
80012024-11-01T22:38:08.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80022024-11-01T22:38:08.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80032024-11-01T22:38:08.526ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.241767ms iteration = 26 status = 0
80042024-11-01T22:38:08.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
80052024-11-01T22:38:08.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.953641ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
80062024-11-01T22:38:08.540ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
80072024-11-01T22:38:08.540ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80082024-11-01T22:38:08.540ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ace0b48-90d7-482b-a744-c9c634f0f979", "content-length": "26", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80092024-11-01T22:38:08.540ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80102024-11-01T22:38:08.541ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
80112024-11-01T22:38:08.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80122024-11-01T22:38:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80132024-11-01T22:38:08.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80142024-11-01T22:38:08.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80152024-11-01T22:38:08.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80162024-11-01T22:38:08.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80172024-11-01T22:38:08.613ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80182024-11-01T22:38:08.614ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.907484ms iteration = 26 status = {}
80192024-11-01T22:38:08.614ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "417b1186-2c80-49e2-ad7e-2b4644966d2b", "content-length": "2", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80202024-11-01T22:38:08.615ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80212024-11-01T22:38:08.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80222024-11-01T22:38:08.643ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80232024-11-01T22:38:08.643ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80242024-11-01T22:38:08.644ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3582ff88-b4fd-49c7-9b69-057fa263b1a8", "content-length": "372", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80252024-11-01T22:38:08.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80262024-11-01T22:38:08.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80272024-11-01T22:38:08.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80282024-11-01T22:38:08.646ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.144848ms iteration = 26 status = null
80292024-11-01T22:38:08.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80302024-11-01T22:38:08.647ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80312024-11-01T22:38:08.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80322024-11-01T22:38:08.695ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80332024-11-01T22:38:08.695ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80342024-11-01T22:38:08.695ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d930561a-806b-483f-8ad8-eb21f736d7a9", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80352024-11-01T22:38:08.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80362024-11-01T22:38:08.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80372024-11-01T22:38:08.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80382024-11-01T22:38:08.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80392024-11-01T22:38:08.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80402024-11-01T22:38:08.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80412024-11-01T22:38:08.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80422024-11-01T22:38:08.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80432024-11-01T22:38:08.709ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
80442024-11-01T22:38:08.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80452024-11-01T22:38:08.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80462024-11-01T22:38:08.712ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80472024-11-01T22:38:08.712ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80482024-11-01T22:38:08.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "268f1207-d22e-4f88-9b4c-496613997d53", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80492024-11-01T22:38:08.714ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.140385ms iteration = 28 status = {}
80502024-11-01T22:38:08.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80512024-11-01T22:38:08.719ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "060143cb-2a3b-4020-83ab-620ad639c750", "content-length": "134", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80522024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80532024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
80542024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80552024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80562024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80572024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80582024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80592024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80602024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80612024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80622024-11-01T22:38:08.719ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
80632024-11-01T22:38:08.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80642024-11-01T22:38:08.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80652024-11-01T22:38:08.721ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80662024-11-01T22:38:08.721ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ac1a65c-c1d3-4e27-9a1c-a91790c5c740", "content-length": "2", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80672024-11-01T22:38:08.721ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80682024-11-01T22:38:08.721ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc02b30b-c3c6-47c5-8c98-19a175c21d6d", "content-length": "52", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80692024-11-01T22:38:08.721ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
80702024-11-01T22:38:08.721ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80712024-11-01T22:38:08.752ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80722024-11-01T22:38:08.867ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cb6d3d59-0a60-4d15-a613-bd96190f34f7", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80732024-11-01T22:38:08.867ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
80742024-11-01T22:38:08.867ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80752024-11-01T22:38:08.867ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9b7f521-b967-4588-a7bb-1c6eb86f2032", "content-length": "682", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80762024-11-01T22:38:08.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80772024-11-01T22:38:08.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80782024-11-01T22:38:08.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80792024-11-01T22:38:08.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80802024-11-01T22:38:08.874ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df6ff1cb-c1af-44e5-8331-ccca82e7d2f5", "content-length": "691", "date": "Fri, 01 Nov 2024 22:38:08 GMT"} })
80812024-11-01T22:38:08.874ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
80822024-11-01T22:38:08.874ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
80832024-11-01T22:38:08.874ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
80842024-11-01T22:38:08.875ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 434.43031ms iteration = 27 status = {}
80852024-11-01T22:38:08.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80862024-11-01T22:38:08.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80872024-11-01T22:38:08.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80882024-11-01T22:38:08.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80892024-11-01T22:38:08.887ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 445.604415ms iteration = 26 status = {}
80902024-11-01T22:38:08.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fa3ad00b-ea38-4e0f-8f9a-dba90999c6aa roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80912024-11-01T22:38:08.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fa3ad00b-ea38-4e0f-8f9a-dba90999c6aa resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80922024-11-01T22:38:08.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = fa3ad00b-ea38-4e0f-8f9a-dba90999c6aa response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80932024-11-01T22:38:09.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b882b58-01aa-46da-8b22-f7c2a01178e3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80942024-11-01T22:38:09.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b882b58-01aa-46da-8b22-f7c2a01178e3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80952024-11-01T22:38:09.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9b882b58-01aa-46da-8b22-f7c2a01178e3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80962024-11-01T22:38:10.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b1f36a38-c0b0-40ef-83bb-6dd05ff7118f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80972024-11-01T22:38:10.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b1f36a38-c0b0-40ef-83bb-6dd05ff7118f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80982024-11-01T22:38:10.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b1f36a38-c0b0-40ef-83bb-6dd05ff7118f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
80992024-11-01T22:38:11.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e0591307-b152-46ac-98a3-dc675c0ceb66 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81002024-11-01T22:38:11.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e0591307-b152-46ac-98a3-dc675c0ceb66 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81012024-11-01T22:38:12.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e0591307-b152-46ac-98a3-dc675c0ceb66 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81022024-11-01T22:38:13.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96b06490-0723-4b16-aef7-21287909ef01 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81032024-11-01T22:38:13.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96b06490-0723-4b16-aef7-21287909ef01 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81042024-11-01T22:38:13.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 96b06490-0723-4b16-aef7-21287909ef01 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81052024-11-01T22:38:13.196ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1571 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 2968cd39-981f-4c76-9efb-490c9690bb60 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
81062024-11-01T22:38:14.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c95eb536-90c9-4167-aa94-b79cb06dad45 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81072024-11-01T22:38:14.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c95eb536-90c9-4167-aa94-b79cb06dad45 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81082024-11-01T22:38:14.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c95eb536-90c9-4167-aa94-b79cb06dad45 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81092024-11-01T22:38:15.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 512e3840-aac4-4b21-a1a3-ab503ddeaf2d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81102024-11-01T22:38:15.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 512e3840-aac4-4b21-a1a3-ab503ddeaf2d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81112024-11-01T22:38:15.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 512e3840-aac4-4b21-a1a3-ab503ddeaf2d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81122024-11-01T22:38:16.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 05c1cafc-dd94-4393-8263-032416018112 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81132024-11-01T22:38:16.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 05c1cafc-dd94-4393-8263-032416018112 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81142024-11-01T22:38:16.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 05c1cafc-dd94-4393-8263-032416018112 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81152024-11-01T22:38:17.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b7d5578d-e00e-43c4-92a7-d1cd27c62bde roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81162024-11-01T22:38:17.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b7d5578d-e00e-43c4-92a7-d1cd27c62bde resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81172024-11-01T22:38:17.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b7d5578d-e00e-43c4-92a7-d1cd27c62bde response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81182024-11-01T22:38:18.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e2ea1d3-b0d0-4df1-a28a-640901cdeae3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81192024-11-01T22:38:18.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e2ea1d3-b0d0-4df1-a28a-640901cdeae3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81202024-11-01T22:38:18.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6e2ea1d3-b0d0-4df1-a28a-640901cdeae3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81212024-11-01T22:38:18.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
81222024-11-01T22:38:18.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
81232024-11-01T22:38:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81242024-11-01T22:38:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81252024-11-01T22:38:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81262024-11-01T22:38:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81272024-11-01T22:38:18.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81282024-11-01T22:38:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81292024-11-01T22:38:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81302024-11-01T22:38:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81312024-11-01T22:38:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81322024-11-01T22:38:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81332024-11-01T22:38:18.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81342024-11-01T22:38:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81352024-11-01T22:38:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81362024-11-01T22:38:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
81372024-11-01T22:38:18.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81382024-11-01T22:38:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81392024-11-01T22:38:18.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
81402024-11-01T22:38:18.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.272697ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
81412024-11-01T22:38:18.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.861225ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81422024-11-01T22:38:18.715ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53554
81432024-11-01T22:38:18.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53554 req_id = 260eb8bd-1287-487b-a782-0bd95bf8d36a roles = RoleSet { roles: {} } uri = /metrics/producers
81442024-11-01T22:38:18.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53554 req_id = 260eb8bd-1287-487b-a782-0bd95bf8d36a resource = Database result = Ok(()) uri = /metrics/producers
81452024-11-01T22:38:18.754ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = eb6325c7-d1c1-4d78-89ec-4210cb4d49a2
81462024-11-01T22:38:18.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39606 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53554 req_id = 260eb8bd-1287-487b-a782-0bd95bf8d36a response_code = 201 uri = /metrics/producers
81472024-11-01T22:38:19.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff7b1418-a214-43fc-b65d-d932202187ba roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81482024-11-01T22:38:19.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff7b1418-a214-43fc-b65d-d932202187ba resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81492024-11-01T22:38:19.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ff7b1418-a214-43fc-b65d-d932202187ba response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81502024-11-01T22:38:20.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7bc45389-b22b-4e1e-b186-78e58c6a1b6f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81512024-11-01T22:38:20.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7bc45389-b22b-4e1e-b186-78e58c6a1b6f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81522024-11-01T22:38:20.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7bc45389-b22b-4e1e-b186-78e58c6a1b6f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81532024-11-01T22:38:20.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = ef97e385-40d0-48b6-be4f-80765f425da2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
81542024-11-01T22:38:20.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = ef97e385-40d0-48b6-be4f-80765f425da2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
81552024-11-01T22:38:20.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = ef97e385-40d0-48b6-be4f-80765f425da2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
81562024-11-01T22:38:20.772ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54325
81572024-11-01T22:38:20.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54325 req_id = 76a2316a-a61d-4f9e-a57c-8a4bfcd2ea52 roles = RoleSet { roles: {} } uri = /metrics/producers
81582024-11-01T22:38:20.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54325 req_id = 76a2316a-a61d-4f9e-a57c-8a4bfcd2ea52 resource = Database result = Ok(()) uri = /metrics/producers
81592024-11-01T22:38:20.808ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 0c64e418-1894-441d-86b0-7394a1124e4a
81602024-11-01T22:38:20.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36403 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54325 req_id = 76a2316a-a61d-4f9e-a57c-8a4bfcd2ea52 response_code = 201 uri = /metrics/producers
81612024-11-01T22:38:21.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6d571cf-f614-434c-a8df-f4a9b4dd55c4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81622024-11-01T22:38:21.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6d571cf-f614-434c-a8df-f4a9b4dd55c4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81632024-11-01T22:38:21.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b6d571cf-f614-434c-a8df-f4a9b4dd55c4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81642024-11-01T22:38:22.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 92fd4bac-4bc1-406e-a4d5-68cf611112c8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81652024-11-01T22:38:22.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 92fd4bac-4bc1-406e-a4d5-68cf611112c8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81662024-11-01T22:38:22.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 92fd4bac-4bc1-406e-a4d5-68cf611112c8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81672024-11-01T22:38:23.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b135de53-9c00-44bb-baf0-81cf5a53ea7d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81682024-11-01T22:38:23.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b135de53-9c00-44bb-baf0-81cf5a53ea7d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81692024-11-01T22:38:23.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b135de53-9c00-44bb-baf0-81cf5a53ea7d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81702024-11-01T22:38:24.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 14477cc0-1bf7-4d17-8408-9d19307e579d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81712024-11-01T22:38:24.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 14477cc0-1bf7-4d17-8408-9d19307e579d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81722024-11-01T22:38:24.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 14477cc0-1bf7-4d17-8408-9d19307e579d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81732024-11-01T22:38:25.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63cb05a4-18c6-4c38-ad03-e999aa71237e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81742024-11-01T22:38:25.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63cb05a4-18c6-4c38-ad03-e999aa71237e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81752024-11-01T22:38:25.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 63cb05a4-18c6-4c38-ad03-e999aa71237e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81762024-11-01T22:38:26.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6984d702-de2a-4e49-9e98-a6d387da8427 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81772024-11-01T22:38:26.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6984d702-de2a-4e49-9e98-a6d387da8427 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81782024-11-01T22:38:26.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6984d702-de2a-4e49-9e98-a6d387da8427 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81792024-11-01T22:38:27.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8de49cff-bb4f-4266-a7fa-6d3fd236b5c3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81802024-11-01T22:38:27.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8de49cff-bb4f-4266-a7fa-6d3fd236b5c3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81812024-11-01T22:38:27.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8de49cff-bb4f-4266-a7fa-6d3fd236b5c3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81822024-11-01T22:38:28.197ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1495 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 9778e859-3e93-4dd9-9a95-c4cf25cb2e35 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
81832024-11-01T22:38:28.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 796a50e7-c080-484f-acdd-2ad9628bbb36 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81842024-11-01T22:38:28.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 796a50e7-c080-484f-acdd-2ad9628bbb36 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81852024-11-01T22:38:28.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 796a50e7-c080-484f-acdd-2ad9628bbb36 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
81862024-11-01T22:38:28.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
81872024-11-01T22:38:28.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
81882024-11-01T22:38:28.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81892024-11-01T22:38:28.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81902024-11-01T22:38:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81912024-11-01T22:38:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81922024-11-01T22:38:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81932024-11-01T22:38:28.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81942024-11-01T22:38:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81952024-11-01T22:38:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81962024-11-01T22:38:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81972024-11-01T22:38:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81982024-11-01T22:38:28.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81992024-11-01T22:38:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82002024-11-01T22:38:28.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82012024-11-01T22:38:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
82022024-11-01T22:38:28.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82032024-11-01T22:38:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82042024-11-01T22:38:28.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
82052024-11-01T22:38:28.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.959374ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
82062024-11-01T22:38:28.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.873465ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82072024-11-01T22:38:29.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b468f249-d6ca-44a5-aecc-a2f3e6073b8a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82082024-11-01T22:38:29.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b468f249-d6ca-44a5-aecc-a2f3e6073b8a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82092024-11-01T22:38:29.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = b468f249-d6ca-44a5-aecc-a2f3e6073b8a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82102024-11-01T22:38:30.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 061bbd24-4ba7-4fb9-8429-db49c9b3cc65 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82112024-11-01T22:38:30.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 061bbd24-4ba7-4fb9-8429-db49c9b3cc65 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82122024-11-01T22:38:30.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 061bbd24-4ba7-4fb9-8429-db49c9b3cc65 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82132024-11-01T22:38:31.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 996baa9e-f139-473b-9bde-ab6d2b562ba8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82142024-11-01T22:38:31.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 996baa9e-f139-473b-9bde-ab6d2b562ba8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82152024-11-01T22:38:31.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 996baa9e-f139-473b-9bde-ab6d2b562ba8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82162024-11-01T22:38:32.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6209c65f-ccde-400b-8413-dd1dd44d4fcd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82172024-11-01T22:38:32.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6209c65f-ccde-400b-8413-dd1dd44d4fcd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82182024-11-01T22:38:32.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 6209c65f-ccde-400b-8413-dd1dd44d4fcd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82192024-11-01T22:38:33.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9a7e73ef-b6b1-4f29-993e-1368b2e73b85 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82202024-11-01T22:38:33.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9a7e73ef-b6b1-4f29-993e-1368b2e73b85 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82212024-11-01T22:38:33.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9a7e73ef-b6b1-4f29-993e-1368b2e73b85 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82222024-11-01T22:38:34.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d23ab701-8e11-434b-bf4e-671beff96cdd roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82232024-11-01T22:38:34.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d23ab701-8e11-434b-bf4e-671beff96cdd resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82242024-11-01T22:38:34.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d23ab701-8e11-434b-bf4e-671beff96cdd response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82252024-11-01T22:38:35.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a7ef36a-b289-4026-93d5-f050abbf7b10 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82262024-11-01T22:38:35.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a7ef36a-b289-4026-93d5-f050abbf7b10 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82272024-11-01T22:38:35.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4a7ef36a-b289-4026-93d5-f050abbf7b10 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82282024-11-01T22:38:36.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4174aaf-c3ad-42e0-94f7-efa61b99bc04 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82292024-11-01T22:38:36.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4174aaf-c3ad-42e0-94f7-efa61b99bc04 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82302024-11-01T22:38:36.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4174aaf-c3ad-42e0-94f7-efa61b99bc04 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82312024-11-01T22:38:37.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e0b64059-ac33-4a7a-a63b-0f763756cf5e roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82322024-11-01T22:38:37.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e0b64059-ac33-4a7a-a63b-0f763756cf5e resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82332024-11-01T22:38:37.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = e0b64059-ac33-4a7a-a63b-0f763756cf5e response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
82342024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
82352024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 18.09\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82362024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
82372024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
82382024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82392024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
82402024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.1\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
82412024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
82422024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
82432024-11-01T22:38:38.441ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
82442024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82452024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82462024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
82472024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82482024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
82492024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82502024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
82512024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
82522024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82532024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
82542024-11-01T22:38:38.441ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6
82552024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
82562024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.46\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6"}
82572024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82582024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82592024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
82602024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
82612024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
82622024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
82632024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82642024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82652024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
82662024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
82672024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82682024-11-01T22:38:38.441ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-01 22:28:38.441684118 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82692024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82702024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
82712024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82722024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
82732024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82742024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82752024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
82762024-11-01T22:38:38.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82772024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
82782024-11-01T22:38:38.442ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82792024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
82802024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82812024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82822024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
82832024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
82842024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82852024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82862024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
82872024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.31\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82882024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
82892024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
82902024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82912024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.42\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
82922024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
82932024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
82942024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82952024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82962024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82972024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82982024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82992024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83002024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83012024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83022024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83032024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83042024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83052024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83062024-11-01T22:38:38.442ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("16f8af4d-7626-4144-90ca-74043fcc6867.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("52d11306-028a-4d00-8d4d-07c571263f67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1638, tv_nsec: 469635031 } })
83072024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
83082024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83092024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
83102024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
83112024-11-01T22:38:38.442ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("15f57006-9470-4df9-8594-2ccba0056607.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1754c72e-4403-4a3f-a3ff-f405c37e6d5d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ec080300-45c7-4a57-85a0-2a1237f519d0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1638, tv_nsec: 469684941 } })
83122024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83132024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83142024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83152024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83162024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83172024-11-01T22:38:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83182024-11-01T22:38:38.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
83192024-11-01T22:38:38.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.609032ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
83202024-11-01T22:38:38.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
83212024-11-01T22:38:38.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.649072ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
83222024-11-01T22:38:38.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83232024-11-01T22:38:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83242024-11-01T22:38:38.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83252024-11-01T22:38:38.446ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.508464ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83262024-11-01T22:38:38.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83272024-11-01T22:38:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83282024-11-01T22:38:38.446ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83292024-11-01T22:38:38.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83302024-11-01T22:38:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83312024-11-01T22:38:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83322024-11-01T22:38:38.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83332024-11-01T22:38:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83342024-11-01T22:38:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83352024-11-01T22:38:38.448ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83362024-11-01T22:38:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83372024-11-01T22:38:38.451ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83382024-11-01T22:38:38.451ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83392024-11-01T22:38:38.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83402024-11-01T22:38:38.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83412024-11-01T22:38:38.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1638, tv_nsec: 478714140 } })
83422024-11-01T22:38:38.451ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-01 22:28:38.441684118 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83432024-11-01T22:38:38.451ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.179537ms iteration = 14 status = {"expiration":"2024-11-01T22:28:38.441684118Z","pruned":[]}
83442024-11-01T22:38:38.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
83452024-11-01T22:38:38.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83462024-11-01T22:38:38.453ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.265286ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
83472024-11-01T22:38:38.454ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1638, tv_nsec: 481717503 } })
83482024-11-01T22:38:38.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
83492024-11-01T22:38:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83502024-11-01T22:38:38.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83512024-11-01T22:38:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83522024-11-01T22:38:38.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83532024-11-01T22:38:38.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83542024-11-01T22:38:38.463ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83552024-11-01T22:38:38.463ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83562024-11-01T22:38:38.463ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83572024-11-01T22:38:38.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83582024-11-01T22:38:38.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83592024-11-01T22:38:38.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83602024-11-01T22:38:38.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83612024-11-01T22:38:38.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83622024-11-01T22:38:38.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83632024-11-01T22:38:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
83642024-11-01T22:38:38.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83652024-11-01T22:38:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83662024-11-01T22:38:38.481ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83672024-11-01T22:38:38.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83682024-11-01T22:38:38.481ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
83692024-11-01T22:38:38.481ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
83702024-11-01T22:38:38.481ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 39.56685ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
83712024-11-01T22:38:38.483ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83722024-11-01T22:38:38.483ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83732024-11-01T22:38:38.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83742024-11-01T22:38:38.483ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83752024-11-01T22:38:38.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83762024-11-01T22:38:38.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83772024-11-01T22:38:38.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83782024-11-01T22:38:38.485ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
83792024-11-01T22:38:38.485ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.589931ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
83802024-11-01T22:38:38.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83812024-11-01T22:38:38.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83822024-11-01T22:38:38.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83832024-11-01T22:38:38.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83842024-11-01T22:38:38.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83852024-11-01T22:38:38.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83862024-11-01T22:38:38.490ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83872024-11-01T22:38:38.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83882024-11-01T22:38:38.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83892024-11-01T22:38:38.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83902024-11-01T22:38:38.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83912024-11-01T22:38:38.491ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1638, tv_nsec: 518559103 } })
83922024-11-01T22:38:38.491ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
83932024-11-01T22:38:38.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83942024-11-01T22:38:38.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83952024-11-01T22:38:38.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83962024-11-01T22:38:38.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83972024-11-01T22:38:38.495ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
83982024-11-01T22:38:38.495ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
83992024-11-01T22:38:38.495ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 54.073061ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84002024-11-01T22:38:38.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84012024-11-01T22:38:38.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84022024-11-01T22:38:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84032024-11-01T22:38:38.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
84042024-11-01T22:38:38.496ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84052024-11-01T22:38:38.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84062024-11-01T22:38:38.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84072024-11-01T22:38:38.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84082024-11-01T22:38:38.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84092024-11-01T22:38:38.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.568907ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84102024-11-01T22:38:38.499ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84112024-11-01T22:38:38.499ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84122024-11-01T22:38:38.499ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.410036ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84132024-11-01T22:38:38.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84142024-11-01T22:38:38.499ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84152024-11-01T22:38:38.499ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.779629ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84162024-11-01T22:38:38.500ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84172024-11-01T22:38:38.500ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84182024-11-01T22:38:38.500ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84192024-11-01T22:38:38.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84202024-11-01T22:38:38.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84212024-11-01T22:38:38.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84222024-11-01T22:38:38.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84232024-11-01T22:38:38.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84242024-11-01T22:38:38.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84252024-11-01T22:38:38.519ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84262024-11-01T22:38:38.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84272024-11-01T22:38:38.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84282024-11-01T22:38:38.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
84292024-11-01T22:38:38.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84302024-11-01T22:38:38.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84312024-11-01T22:38:38.526ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.246947ms iteration = 27 status = 0
84322024-11-01T22:38:38.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84332024-11-01T22:38:38.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.339707ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84342024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84352024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84362024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84372024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84382024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84392024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84402024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84412024-11-01T22:38:38.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84422024-11-01T22:38:38.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84432024-11-01T22:38:38.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84442024-11-01T22:38:38.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84452024-11-01T22:38:38.545ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84462024-11-01T22:38:38.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84472024-11-01T22:38:38.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84482024-11-01T22:38:38.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84492024-11-01T22:38:38.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84502024-11-01T22:38:38.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84512024-11-01T22:38:38.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84522024-11-01T22:38:38.552ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84532024-11-01T22:38:38.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84542024-11-01T22:38:38.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84552024-11-01T22:38:38.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84562024-11-01T22:38:38.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84572024-11-01T22:38:38.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84582024-11-01T22:38:38.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84592024-11-01T22:38:38.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84602024-11-01T22:38:38.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84612024-11-01T22:38:38.565ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84622024-11-01T22:38:38.565ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 0 version = 2
84632024-11-01T22:38:38.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84642024-11-01T22:38:38.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84652024-11-01T22:38:38.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84662024-11-01T22:38:38.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84672024-11-01T22:38:38.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84682024-11-01T22:38:38.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84692024-11-01T22:38:38.577ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 42c6040d-8ef0-40fc-a99f-a2b2bed47d37 dns_zone_name = oxide.test found_so_far = 1 version = 2
84702024-11-01T22:38:38.577ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
84712024-11-01T22:38:38.577ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-01 22:26:09.250374 UTC dns_group = external generation = 2
84722024-11-01T22:38:38.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 136.422006ms iteration = 15 status = {"generation":2}
84732024-11-01T22:38:38.581ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.930213ms iteration = 31 status = {"physical_disks_added":0}
84742024-11-01T22:38:38.597ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
84752024-11-01T22:38:38.597ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
84762024-11-01T22:38:38.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84772024-11-01T22:38:38.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84782024-11-01T22:38:38.599ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
84792024-11-01T22:38:38.599ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84802024-11-01T22:38:38.599ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29d5de5c-6c9a-4bf5-82af-5ea45f41644d", "content-length": "26", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
84812024-11-01T22:38:38.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84822024-11-01T22:38:38.601ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84832024-11-01T22:38:38.603ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-01T22:25:36.821862Z, time_modified: 2024-11-01T22:25:36.821862Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, db_silo: Silo { identity: SiloIdentity { id: 42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-01T22:26:09.209258Z, time_modified: 2024-11-01T22:26:09.209258Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c" }] }) }
84842024-11-01T22:38:38.603ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 162.111952ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]}},"default_endpoint":{"silo_id":"42f2c3c8-b9be-422e-8f46-9f7d8aeb64b5","tls_certs":["9591dac1477b89e33087991d93237522643f7787fb334058039879de2391281c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
84852024-11-01T22:38:38.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84862024-11-01T22:38:38.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84872024-11-01T22:38:38.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2aef6463-ee85-4994-b158-110c245885e9 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
84882024-11-01T22:38:38.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2aef6463-ee85-4994-b158-110c245885e9 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
84892024-11-01T22:38:38.650ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
84902024-11-01T22:38:38.650ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84912024-11-01T22:38:38.650ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ec966d-18ef-4cac-9f43-984fa00ac8f3", "content-length": "26", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
84922024-11-01T22:38:38.650ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84932024-11-01T22:38:38.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
84942024-11-01T22:38:38.669ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
84952024-11-01T22:38:38.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 228.264794ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
84962024-11-01T22:38:38.714ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84972024-11-01T22:38:38.747ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84982024-11-01T22:38:38.747ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84992024-11-01T22:38:38.747ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c303007-ae08-4b5b-87c6-c7a61d824448", "content-length": "372", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85002024-11-01T22:38:38.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85012024-11-01T22:38:38.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85022024-11-01T22:38:38.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85032024-11-01T22:38:38.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85042024-11-01T22:38:38.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85052024-11-01T22:38:38.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85062024-11-01T22:38:38.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85072024-11-01T22:38:38.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85082024-11-01T22:38:38.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85092024-11-01T22:38:38.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85102024-11-01T22:38:38.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2aef6463-ee85-4994-b158-110c245885e9 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
85112024-11-01T22:38:38.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85122024-11-01T22:38:38.764ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 674d3387-6b3d-4f05-a1f3-163d3695fc11 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
85132024-11-01T22:38:38.764ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85142024-11-01T22:38:38.764ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-01 22:26:08.764416 UTC dns_group = internal generation = 1
85152024-11-01T22:38:38.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 322.58335ms iteration = 15 status = {"generation":1}
85162024-11-01T22:38:38.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85172024-11-01T22:38:38.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85182024-11-01T22:38:38.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85192024-11-01T22:38:38.784ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
85202024-11-01T22:38:38.784ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85212024-11-01T22:38:38.785ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec364c0d-dc05-4817-a769-12fba270bd7b", "content-length": "26", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85222024-11-01T22:38:38.785ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85232024-11-01T22:38:38.787ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85242024-11-01T22:38:38.798ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.319564ms iteration = 27 status = {}
85252024-11-01T22:38:38.815ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85262024-11-01T22:38:38.821ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85272024-11-01T22:38:38.821ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85282024-11-01T22:38:38.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1492e145-bf66-408b-8f0c-40e5e54404a0", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85292024-11-01T22:38:38.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85302024-11-01T22:38:38.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85312024-11-01T22:38:38.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85322024-11-01T22:38:38.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85332024-11-01T22:38:38.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85342024-11-01T22:38:38.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85352024-11-01T22:38:38.831ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85362024-11-01T22:38:38.831ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85372024-11-01T22:38:38.831ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae0a251e-d416-4487-93ca-5a97dd7ab436", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85382024-11-01T22:38:38.833ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.975027ms iteration = 29 status = {}
85392024-11-01T22:38:38.885ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85402024-11-01T22:38:38.885ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3afe02bd-d4ed-484c-8832-67baf228ad71", "content-length": "2", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85412024-11-01T22:38:38.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85422024-11-01T22:38:38.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85432024-11-01T22:38:38.889ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.387498ms iteration = 27 status = null
85442024-11-01T22:38:38.985ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85452024-11-01T22:38:38.985ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e27ed367-72a6-4233-ba11-d66e918eaf6f", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85462024-11-01T22:38:38.985ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85472024-11-01T22:38:38.988ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5303bb2b-bc59-4152-969b-6fa97134e0d0", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85482024-11-01T22:38:38.988ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85492024-11-01T22:38:38.989ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85502024-11-01T22:38:38.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 548.442376ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85512024-11-01T22:38:39.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85522024-11-01T22:38:39.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a385f946-e0f3-46a5-b18f-33501eb04db7", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85532024-11-01T22:38:39.001ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85542024-11-01T22:38:39.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "20003f44-dd98-46ab-a2f2-a7c8bd4fd864", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85552024-11-01T22:38:39.003ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85562024-11-01T22:38:39.005ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "946adaea-98eb-4333-b5f3-9aa5bb6de3e4", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85572024-11-01T22:38:39.005ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85582024-11-01T22:38:39.007ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85592024-11-01T22:38:39.007ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85602024-11-01T22:38:39.007ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 566.20472ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85612024-11-01T22:38:39.008ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a3ed9df-b706-4a13-afdc-8f71828fd1d8", "content-length": "691", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85622024-11-01T22:38:39.008ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85632024-11-01T22:38:39.008ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85642024-11-01T22:38:39.008ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85652024-11-01T22:38:39.009ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 568.130786ms iteration = 28 status = {}
85662024-11-01T22:38:39.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85672024-11-01T22:38:39.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85682024-11-01T22:38:39.056ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
85692024-11-01T22:38:39.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85702024-11-01T22:38:39.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85712024-11-01T22:38:39.067ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85722024-11-01T22:38:39.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c726ae8-30df-4b79-aad6-6d1591af3e9e", "content-length": "134", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85732024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85742024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
85752024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85762024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85772024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85782024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85792024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85802024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85812024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85822024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85832024-11-01T22:38:39.068ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
85842024-11-01T22:38:39.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85852024-11-01T22:38:39.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85862024-11-01T22:38:39.071ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85872024-11-01T22:38:39.071ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "23c0c3d1-9e3b-4336-bb19-45c72c9fc9ed", "content-length": "2", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85882024-11-01T22:38:39.071ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85892024-11-01T22:38:39.071ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c54c82e9-60b4-4838-ab0b-6b101c21c6e4", "content-length": "52", "date": "Fri, 01 Nov 2024 22:38:38 GMT"} })
85902024-11-01T22:38:39.071ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
85912024-11-01T22:38:39.071ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85922024-11-01T22:38:39.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8cba1913-82c6-41de-921c-99b88859a8fa", "date": "Fri, 01 Nov 2024 22:38:39 GMT"} })
85932024-11-01T22:38:39.274ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
85942024-11-01T22:38:39.274ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85952024-11-01T22:38:39.278ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b2a8bfb-4770-404d-8940-427525bbd8d6", "content-length": "682", "date": "Fri, 01 Nov 2024 22:38:39 GMT"} })
85962024-11-01T22:38:39.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85972024-11-01T22:38:39.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85982024-11-01T22:38:39.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85992024-11-01T22:38:39.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86002024-11-01T22:38:39.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86012024-11-01T22:38:39.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86022024-11-01T22:38:39.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86032024-11-01T22:38:39.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86042024-11-01T22:38:39.294ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 853.249691ms iteration = 27 status = {}
86052024-11-01T22:38:39.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bb21b6d9-4024-4625-b62b-67334222ac37 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86062024-11-01T22:38:39.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bb21b6d9-4024-4625-b62b-67334222ac37 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86072024-11-01T22:38:39.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bb21b6d9-4024-4625-b62b-67334222ac37 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86082024-11-01T22:38:40.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7cc2b205-3fc3-4c88-8e38-179ba3914799 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86092024-11-01T22:38:40.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7cc2b205-3fc3-4c88-8e38-179ba3914799 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86102024-11-01T22:38:40.806ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
86112024-11-01T22:38:40.806ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
86122024-11-01T22:38:40.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7cc2b205-3fc3-4c88-8e38-179ba3914799 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86132024-11-01T22:38:40.836ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
86142024-11-01T22:38:40.836ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36427
86152024-11-01T22:38:40.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36427 req_id = 4b1cfa50-399a-481e-b32d-0d321532c600 roles = RoleSet { roles: {} } uri = /metrics/producers
86162024-11-01T22:38:40.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36427 req_id = 4b1cfa50-399a-481e-b32d-0d321532c600 resource = Database result = Ok(()) uri = /metrics/producers
86172024-11-01T22:38:40.871ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 7e5351f7-5c9c-48ef-96e0-d88878eeb116
86182024-11-01T22:38:40.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35100 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36427 req_id = 4b1cfa50-399a-481e-b32d-0d321532c600 response_code = 201 uri = /metrics/producers
86192024-11-01T22:38:40.871ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4b1cfa50-399a-481e-b32d-0d321532c600", "content-length": "41", "date": "Fri, 01 Nov 2024 22:38:40 GMT"} })
86202024-11-01T22:38:40.873ZDEBGnexus (producer-registration-task): registered with nexus successfully
86212024-11-01T22:38:40.873ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
86222024-11-01T22:38:41.198ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62321
86232024-11-01T22:38:41.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62321 req_id = 0ab573a6-804a-4311-b6f1-6fad1e20d1b7 roles = RoleSet { roles: {} } uri = /metrics/producers
86242024-11-01T22:38:41.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62321 req_id = 0ab573a6-804a-4311-b6f1-6fad1e20d1b7 resource = Database result = Ok(()) uri = /metrics/producers
86252024-11-01T22:38:41.234ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = f3786bce-13d3-45c6-95c4-d92d9e1f531e
86262024-11-01T22:38:41.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36070 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62321 req_id = 0ab573a6-804a-4311-b6f1-6fad1e20d1b7 response_code = 201 uri = /metrics/producers
86272024-11-01T22:38:41.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8090cbca-4969-41ee-97b3-d8e1f241508d roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86282024-11-01T22:38:41.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8090cbca-4969-41ee-97b3-d8e1f241508d resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86292024-11-01T22:38:41.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 8090cbca-4969-41ee-97b3-d8e1f241508d response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86302024-11-01T22:38:42.800ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39955
86312024-11-01T22:38:42.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39955 req_id = f862953d-2fb5-41bd-a610-659ac072ae6f roles = RoleSet { roles: {} } uri = /metrics/producers
86322024-11-01T22:38:42.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39955 req_id = f862953d-2fb5-41bd-a610-659ac072ae6f resource = Database result = Ok(()) uri = /metrics/producers
86332024-11-01T22:38:42.836ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 6a9b750b-1518-4ee5-bf47-863dffe85843
86342024-11-01T22:38:42.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35867 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39955 req_id = f862953d-2fb5-41bd-a610-659ac072ae6f response_code = 201 uri = /metrics/producers
86352024-11-01T22:38:42.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 48b983d0-1a09-4258-a645-a2632a1a8c1a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86362024-11-01T22:38:42.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 48b983d0-1a09-4258-a645-a2632a1a8c1a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86372024-11-01T22:38:42.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 48b983d0-1a09-4258-a645-a2632a1a8c1a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86382024-11-01T22:38:43.198ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 080a8720-62f1-4874-8df3-d3872e53399d response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
86392024-11-01T22:38:43.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57cb1c4b-a39e-4891-8d1f-3c370a0e892a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86402024-11-01T22:38:43.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57cb1c4b-a39e-4891-8d1f-3c370a0e892a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86412024-11-01T22:38:43.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 57cb1c4b-a39e-4891-8d1f-3c370a0e892a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86422024-11-01T22:38:44.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 233fb188-27e3-4404-ac7e-06872389d4b1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86432024-11-01T22:38:44.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 233fb188-27e3-4404-ac7e-06872389d4b1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86442024-11-01T22:38:44.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 233fb188-27e3-4404-ac7e-06872389d4b1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86452024-11-01T22:38:45.715ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:49922
86462024-11-01T22:38:45.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49922 req_id = 6306c1a2-62fb-44f4-a3af-ff14e016848e roles = RoleSet { roles: {} } uri = /metrics/producers
86472024-11-01T22:38:45.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49922 req_id = 6306c1a2-62fb-44f4-a3af-ff14e016848e resource = Database result = Ok(()) uri = /metrics/producers
86482024-11-01T22:38:45.750ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 66c10e19-a80d-4554-a39b-bc1969f7015e
86492024-11-01T22:38:45.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34914 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49922 req_id = 6306c1a2-62fb-44f4-a3af-ff14e016848e response_code = 201 uri = /metrics/producers
86502024-11-01T22:38:45.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce2672b0-3c7a-41d0-a9db-f896277e8fe1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86512024-11-01T22:38:45.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce2672b0-3c7a-41d0-a9db-f896277e8fe1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86522024-11-01T22:38:45.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ce2672b0-3c7a-41d0-a9db-f896277e8fe1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86532024-11-01T22:38:46.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 14cf60e0-76c2-46a1-b8e3-2acc5e85990f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86542024-11-01T22:38:46.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 14cf60e0-76c2-46a1-b8e3-2acc5e85990f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86552024-11-01T22:38:46.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 14cf60e0-76c2-46a1-b8e3-2acc5e85990f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86562024-11-01T22:38:47.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 25d26ee7-a493-46a0-9c47-96df2a1cdc67 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86572024-11-01T22:38:47.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 25d26ee7-a493-46a0-9c47-96df2a1cdc67 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86582024-11-01T22:38:47.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 25d26ee7-a493-46a0-9c47-96df2a1cdc67 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86592024-11-01T22:38:48.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = dca8ecbe-267e-40de-b549-e43430f9f9f5 roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
86602024-11-01T22:38:48.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = dca8ecbe-267e-40de-b549-e43430f9f9f5 resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
86612024-11-01T22:38:48.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = dca8ecbe-267e-40de-b549-e43430f9f9f5 response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?sort_by=id_ascending
86622024-11-01T22:38:48.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = fe8b3438-c544-4679-aefc-d7644c036c1c roles = RoleSet { roles: {} } uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
86632024-11-01T22:38:48.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = fe8b3438-c544-4679-aefc-d7644c036c1c resource = Database result = Ok(()) uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
86642024-11-01T22:38:48.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43987 req_id = fe8b3438-c544-4679-aefc-d7644c036c1c response_code = 200 uri = /metrics/collectors/96b096b4-5564-4c3b-9644-bfe0934f43d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMzc4NmJjZS0xM2QzLTQ1YzYtOTVjNC1kOTJkOWUxZjUzMWUifX0%3D
86652024-11-01T22:38:48.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
86662024-11-01T22:38:48.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
86672024-11-01T22:38:48.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86682024-11-01T22:38:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86692024-11-01T22:38:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86702024-11-01T22:38:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86712024-11-01T22:38:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86722024-11-01T22:38:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86732024-11-01T22:38:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86742024-11-01T22:38:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86752024-11-01T22:38:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86762024-11-01T22:38:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86772024-11-01T22:38:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86782024-11-01T22:38:48.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
86792024-11-01T22:38:48.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86802024-11-01T22:38:48.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86812024-11-01T22:38:48.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
86822024-11-01T22:38:48.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.112666ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
86832024-11-01T22:38:48.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86842024-11-01T22:38:48.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86852024-11-01T22:38:48.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.753164ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86862024-11-01T22:38:48.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 80dcc12c-c433-416b-addb-0922b3ca16d1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86872024-11-01T22:38:48.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 80dcc12c-c433-416b-addb-0922b3ca16d1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86882024-11-01T22:38:48.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 80dcc12c-c433-416b-addb-0922b3ca16d1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86892024-11-01T22:38:49.933ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40303
86902024-11-01T22:38:49.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40303 req_id = bdb03799-4d47-4c4d-b661-8a550d4f34bb roles = RoleSet { roles: {} } uri = /metrics/producers
86912024-11-01T22:38:49.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40303 req_id = bdb03799-4d47-4c4d-b661-8a550d4f34bb resource = Database result = Ok(()) uri = /metrics/producers
86922024-11-01T22:38:49.946ZINFOnexus: assigned collector to new producer collector_id = 96b096b4-5564-4c3b-9644-bfe0934f43d1 file = nexus/src/app/oximeter.rs:76 producer_id = 8559b5a7-3301-45c6-8f36-6213ed147b79
86932024-11-01T22:38:49.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13453 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40303 req_id = bdb03799-4d47-4c4d-b661-8a550d4f34bb response_code = 201 uri = /metrics/producers
86942024-11-01T22:38:50.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3180f1e2-9778-4c0a-8b55-e33e941a20a7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86952024-11-01T22:38:50.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3180f1e2-9778-4c0a-8b55-e33e941a20a7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86962024-11-01T22:38:50.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3180f1e2-9778-4c0a-8b55-e33e941a20a7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
86972024-11-01T22:38:50.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = a6551768-00ab-4cfc-b9b6-6bb7ec895059 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
86982024-11-01T22:38:50.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = a6551768-00ab-4cfc-b9b6-6bb7ec895059 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
86992024-11-01T22:38:50.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = a6551768-00ab-4cfc-b9b6-6bb7ec895059 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
87002024-11-01T22:38:51.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3fc677b-e8df-4da8-b9c3-b9e668e8480f roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87012024-11-01T22:38:51.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3fc677b-e8df-4da8-b9c3-b9e668e8480f resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87022024-11-01T22:38:51.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f3fc677b-e8df-4da8-b9c3-b9e668e8480f response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87032024-11-01T22:38:52.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 61df6e25-02dd-4b72-88e6-5d0defe00df3 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87042024-11-01T22:38:52.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 61df6e25-02dd-4b72-88e6-5d0defe00df3 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87052024-11-01T22:38:52.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 61df6e25-02dd-4b72-88e6-5d0defe00df3 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87062024-11-01T22:38:53.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6ed6f39-9d52-424a-8d9b-4077d95c3ff8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87072024-11-01T22:38:53.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6ed6f39-9d52-424a-8d9b-4077d95c3ff8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87082024-11-01T22:38:53.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a6ed6f39-9d52-424a-8d9b-4077d95c3ff8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87092024-11-01T22:38:54.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1a321e9e-75e8-40e0-ae35-0700d3632841 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87102024-11-01T22:38:54.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1a321e9e-75e8-40e0-ae35-0700d3632841 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87112024-11-01T22:38:54.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 1a321e9e-75e8-40e0-ae35-0700d3632841 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87122024-11-01T22:38:55.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4a5174e-aecd-4f31-a255-cc701ca76313 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87132024-11-01T22:38:55.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4a5174e-aecd-4f31-a255-cc701ca76313 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87142024-11-01T22:38:55.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a4a5174e-aecd-4f31-a255-cc701ca76313 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87152024-11-01T22:38:56.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0760a9af-b3ed-4b3a-900b-84b47cb53713 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87162024-11-01T22:38:56.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0760a9af-b3ed-4b3a-900b-84b47cb53713 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87172024-11-01T22:38:56.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0760a9af-b3ed-4b3a-900b-84b47cb53713 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87182024-11-01T22:38:57.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d00fb938-788f-4de8-86bf-3ad2473d14cf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87192024-11-01T22:38:57.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d00fb938-788f-4de8-86bf-3ad2473d14cf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87202024-11-01T22:38:57.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d00fb938-788f-4de8-86bf-3ad2473d14cf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87212024-11-01T22:38:58.198ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = cee90d6d-4482-4601-9870-488086c41523 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
87222024-11-01T22:38:58.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cde6502f-c917-485c-b07b-772dfaff21a2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87232024-11-01T22:38:58.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cde6502f-c917-485c-b07b-772dfaff21a2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87242024-11-01T22:38:58.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = cde6502f-c917-485c-b07b-772dfaff21a2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87252024-11-01T22:38:58.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
87262024-11-01T22:38:58.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
87272024-11-01T22:38:58.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87282024-11-01T22:38:58.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87292024-11-01T22:38:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87302024-11-01T22:38:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87312024-11-01T22:38:58.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87322024-11-01T22:38:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87332024-11-01T22:38:58.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87342024-11-01T22:38:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87352024-11-01T22:38:58.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87362024-11-01T22:38:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87372024-11-01T22:38:58.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87382024-11-01T22:38:58.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
87392024-11-01T22:38:58.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87402024-11-01T22:38:58.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87412024-11-01T22:38:58.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
87422024-11-01T22:38:58.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.39313ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
87432024-11-01T22:38:58.470ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87442024-11-01T22:38:58.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87452024-11-01T22:38:58.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.301297ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87462024-11-01T22:38:59.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4646e144-beb1-4d83-9a36-2833a06ae2f2 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87472024-11-01T22:38:59.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4646e144-beb1-4d83-9a36-2833a06ae2f2 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87482024-11-01T22:38:59.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4646e144-beb1-4d83-9a36-2833a06ae2f2 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87492024-11-01T22:39:00.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0a52cc82-d921-491f-96eb-818c85a5dc24 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87502024-11-01T22:39:00.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0a52cc82-d921-491f-96eb-818c85a5dc24 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87512024-11-01T22:39:00.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0a52cc82-d921-491f-96eb-818c85a5dc24 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87522024-11-01T22:39:01.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7ec0c09a-13f2-4954-b72e-4411b18c9b86 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87532024-11-01T22:39:01.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7ec0c09a-13f2-4954-b72e-4411b18c9b86 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87542024-11-01T22:39:01.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7ec0c09a-13f2-4954-b72e-4411b18c9b86 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87552024-11-01T22:39:02.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 161b0f45-d5f2-4523-94d7-288a450fdeef roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87562024-11-01T22:39:02.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 161b0f45-d5f2-4523-94d7-288a450fdeef resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87572024-11-01T22:39:02.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 161b0f45-d5f2-4523-94d7-288a450fdeef response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87582024-11-01T22:39:03.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aa52824b-e46d-416c-8d6a-0ae545a112c4 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87592024-11-01T22:39:03.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aa52824b-e46d-416c-8d6a-0ae545a112c4 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87602024-11-01T22:39:03.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = aa52824b-e46d-416c-8d6a-0ae545a112c4 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87612024-11-01T22:39:04.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f67aca7f-41af-42bb-a073-399c901daee8 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87622024-11-01T22:39:04.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f67aca7f-41af-42bb-a073-399c901daee8 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87632024-11-01T22:39:04.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = f67aca7f-41af-42bb-a073-399c901daee8 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87642024-11-01T22:39:05.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 811c30da-ecf3-48e3-a860-c4f90c7b2bca roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87652024-11-01T22:39:05.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 811c30da-ecf3-48e3-a860-c4f90c7b2bca resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87662024-11-01T22:39:05.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 811c30da-ecf3-48e3-a860-c4f90c7b2bca response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87672024-11-01T22:39:06.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e3a58c2-214d-4b6c-b14b-9124e32d52df roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87682024-11-01T22:39:06.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e3a58c2-214d-4b6c-b14b-9124e32d52df resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87692024-11-01T22:39:06.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 9e3a58c2-214d-4b6c-b14b-9124e32d52df response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87702024-11-01T22:39:07.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 985c69c5-dd33-4670-bbe9-f612d66b541c roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87712024-11-01T22:39:07.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 985c69c5-dd33-4670-bbe9-f612d66b541c resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87722024-11-01T22:39:07.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 985c69c5-dd33-4670-bbe9-f612d66b541c response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
87732024-11-01T22:39:08.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
87742024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 27.311\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
87752024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
87762024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
87772024-11-01T22:39:08.441ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87782024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
87792024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87802024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87812024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87822024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
87832024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.8\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
87842024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
87852024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
87862024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87872024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
87882024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87892024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
87902024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87912024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87922024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87932024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
87942024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
87952024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87962024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87972024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
87982024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87992024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
88002024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
88012024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88022024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
88032024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
88042024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.441\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88052024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
88062024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.571\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
88072024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88082024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88092024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88102024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88112024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88122024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88132024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88142024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88152024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88162024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88172024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88182024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88192024-11-01T22:39:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88202024-11-01T22:39:08.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88212024-11-01T22:39:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88222024-11-01T22:39:08.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88232024-11-01T22:39:08.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.245645ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88242024-11-01T22:39:08.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88252024-11-01T22:39:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88262024-11-01T22:39:08.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88272024-11-01T22:39:08.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88282024-11-01T22:39:08.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88292024-11-01T22:39:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88302024-11-01T22:39:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88312024-11-01T22:39:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88322024-11-01T22:39:08.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88332024-11-01T22:39:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88342024-11-01T22:39:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88352024-11-01T22:39:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88362024-11-01T22:39:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88372024-11-01T22:39:08.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 82faf88e-879a-4573-a8b0-f812bc8ee4ce roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
88382024-11-01T22:39:08.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 82faf88e-879a-4573-a8b0-f812bc8ee4ce resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
88392024-11-01T22:39:08.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1668, tv_nsec: 476280081 } })
88402024-11-01T22:39:08.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
88412024-11-01T22:39:08.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88422024-11-01T22:39:08.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1668, tv_nsec: 477930244 } })
88432024-11-01T22:39:08.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
88442024-11-01T22:39:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88452024-11-01T22:39:08.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88462024-11-01T22:39:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88472024-11-01T22:39:08.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88482024-11-01T22:39:08.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88492024-11-01T22:39:08.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88502024-11-01T22:39:08.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 82faf88e-879a-4573-a8b0-f812bc8ee4ce response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
88512024-11-01T22:39:08.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88522024-11-01T22:39:08.456ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88532024-11-01T22:39:08.456ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 15.061164ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88542024-11-01T22:39:08.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8559b5a7-3301-45c6-8f36-6213ed147b79.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1668, tv_nsec: 483139103 } })
88552024-11-01T22:39:08.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
88562024-11-01T22:39:08.479ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88572024-11-01T22:39:08.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88582024-11-01T22:39:08.482ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88592024-11-01T22:39:08.482ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88602024-11-01T22:39:08.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88612024-11-01T22:39:08.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88622024-11-01T22:39:08.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88632024-11-01T22:39:08.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88642024-11-01T22:39:08.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88652024-11-01T22:39:08.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88662024-11-01T22:39:08.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88672024-11-01T22:39:08.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88682024-11-01T22:39:08.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88692024-11-01T22:39:08.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88702024-11-01T22:39:08.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88712024-11-01T22:39:08.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88722024-11-01T22:39:08.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88732024-11-01T22:39:08.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88742024-11-01T22:39:08.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88752024-11-01T22:39:08.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88762024-11-01T22:39:08.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
88772024-11-01T22:39:08.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88782024-11-01T22:39:08.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88792024-11-01T22:39:08.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88802024-11-01T22:39:08.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88812024-11-01T22:39:08.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88822024-11-01T22:39:08.508ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
88832024-11-01T22:39:08.508ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88842024-11-01T22:39:08.509ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ca11baf-a9cb-45ad-bd16-722c19c95fe5", "content-length": "26", "date": "Fri, 01 Nov 2024 22:39:07 GMT"} })
88852024-11-01T22:39:08.509ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88862024-11-01T22:39:08.509ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
88872024-11-01T22:39:08.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.768613ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
88882024-11-01T22:39:08.510ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88892024-11-01T22:39:08.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88902024-11-01T22:39:08.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88912024-11-01T22:39:08.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
88922024-11-01T22:39:08.515ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88932024-11-01T22:39:08.516ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "122f1948-4611-47bf-b669-02a55b6db8d4", "content-length": "26", "date": "Fri, 01 Nov 2024 22:39:07 GMT"} })
88942024-11-01T22:39:08.516ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88952024-11-01T22:39:08.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88962024-11-01T22:39:08.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88972024-11-01T22:39:08.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88982024-11-01T22:39:08.519ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88992024-11-01T22:39:08.520ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89002024-11-01T22:39:08.520ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89012024-11-01T22:39:08.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89022024-11-01T22:39:08.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.299702ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89032024-11-01T22:39:08.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89042024-11-01T22:39:08.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8559b5a7-3301-45c6-8f36-6213ed147b79, lookup_type: ById(8559b5a7-3301-45c6-8f36-6213ed147b79) } result = Ok(())
89052024-11-01T22:39:08.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89062024-11-01T22:39:08.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89072024-11-01T22:39:08.524ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.277362ms iteration = 28 status = 0
89082024-11-01T22:39:08.527ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 zone_address = fd00:1122:3344:101::2
89092024-11-01T22:39:08.527ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89102024-11-01T22:39:08.527ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b88109ee-d97c-4f5a-9cf6-9fb3be065d95", "content-length": "26", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89112024-11-01T22:39:08.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89122024-11-01T22:39:08.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
89132024-11-01T22:39:08.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.303098ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89142024-11-01T22:39:08.553ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89152024-11-01T22:39:08.553ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89162024-11-01T22:39:08.553ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.188802ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89172024-11-01T22:39:08.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89182024-11-01T22:39:08.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89192024-11-01T22:39:08.601ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.729421ms iteration = 32 status = {"physical_disks_added":0}
89202024-11-01T22:39:08.603ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89212024-11-01T22:39:08.603ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0d5cdad-0a24-42ce-b3e3-6c6222f6f32d", "content-length": "2", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89222024-11-01T22:39:08.604ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89232024-11-01T22:39:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89242024-11-01T22:39:08.613ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.140298ms iteration = 28 status = {}
89252024-11-01T22:39:08.645ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89262024-11-01T22:39:08.645ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89272024-11-01T22:39:08.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d09a2d03-ea60-437d-b430-a9103acb0356", "content-length": "372", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89282024-11-01T22:39:08.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89292024-11-01T22:39:08.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89302024-11-01T22:39:08.647ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 206.307917ms iteration = 28 status = null
89312024-11-01T22:39:08.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89322024-11-01T22:39:08.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89332024-11-01T22:39:08.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89342024-11-01T22:39:08.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89352024-11-01T22:39:08.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89362024-11-01T22:39:08.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89372024-11-01T22:39:08.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89382024-11-01T22:39:08.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89392024-11-01T22:39:08.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89402024-11-01T22:39:08.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89412024-11-01T22:39:08.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89422024-11-01T22:39:08.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89432024-11-01T22:39:08.695ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
89442024-11-01T22:39:08.695ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89452024-11-01T22:39:08.696ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ca01bc7a-43e1-4f1b-93db-e491c10a52f0", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89462024-11-01T22:39:08.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89472024-11-01T22:39:08.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89482024-11-01T22:39:08.697ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9b5cc279-6821-499d-9fbc-ffc4b50d9405, rack_id: 361f7171-32b8-4689-88bd-41bdd63c83f9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(66e7728a-0808-464b-8748-dd9b1c41ed31) } rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
89492024-11-01T22:39:08.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89502024-11-01T22:39:08.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89512024-11-01T22:39:08.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89522024-11-01T22:39:08.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89532024-11-01T22:39:08.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89542024-11-01T22:39:08.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89552024-11-01T22:39:08.707ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89562024-11-01T22:39:08.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7db4c9-3124-4b0c-a097-5c6142b108e5", "content-length": "134", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89572024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89582024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 66e7728a-0808-464b-8748-dd9b1c41ed31
89592024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89602024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89612024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89622024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89632024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89642024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89652024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89662024-11-01T22:39:08.708ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89672024-11-01T22:39:08.709ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9
89682024-11-01T22:39:08.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89692024-11-01T22:39:08.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89702024-11-01T22:39:08.710ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89712024-11-01T22:39:08.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a540c8e-5cfc-4563-a11a-611e012255b0", "content-length": "2", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89722024-11-01T22:39:08.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89732024-11-01T22:39:08.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c0845e1-d5d5-4a24-9ab4-6cd58c6fe443", "content-length": "52", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89742024-11-01T22:39:08.711ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch_location = Switch0
89752024-11-01T22:39:08.711ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89762024-11-01T22:39:08.711ZINFOnexus (BackgroundTasks): VPC route manager sled 8559b5a7-3301-45c6-8f36-6213ed147b79 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89772024-11-01T22:39:08.711ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89782024-11-01T22:39:08.762ZDEBGnexus (BackgroundTasks): client request SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89792024-11-01T22:39:08.846ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bfa2ac43-731b-4f05-ba2d-8663317b5dfa", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89802024-11-01T22:39:08.846ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 switch = Switch0
89812024-11-01T22:39:08.846ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89822024-11-01T22:39:08.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "86ea494b-4b19-40a7-9253-1f89041dce7c", "content-length": "691", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89832024-11-01T22:39:08.846ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
89842024-11-01T22:39:08.846ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
89852024-11-01T22:39:08.846ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
89862024-11-01T22:39:08.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 8559b5a7-3301-45c6-8f36-6213ed147b79 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a9a13d94-30d6-41de-b478-27ac1c09806b", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89872024-11-01T22:39:08.846ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 361f7171-32b8-4689-88bd-41bdd63c83f9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ba30c1-db45-4c39-9709-595d960441c1", "content-length": "682", "date": "Fri, 01 Nov 2024 22:39:08 GMT"} })
89882024-11-01T22:39:08.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89892024-11-01T22:39:08.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89902024-11-01T22:39:08.848ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 407.088222ms iteration = 29 status = {}
89912024-11-01T22:39:08.848ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 407.360843ms iteration = 30 status = {}
89922024-11-01T22:39:08.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89932024-11-01T22:39:08.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89942024-11-01T22:39:08.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89952024-11-01T22:39:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89962024-11-01T22:39:08.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89972024-11-01T22:39:08.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89982024-11-01T22:39:08.865ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 424.183792ms iteration = 28 status = {}
89992024-11-01T22:39:09.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d66c7684-320f-4660-b342-847510d5c0bf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90002024-11-01T22:39:09.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d66c7684-320f-4660-b342-847510d5c0bf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90012024-11-01T22:39:09.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d66c7684-320f-4660-b342-847510d5c0bf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90022024-11-01T22:39:10.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00a5dd62-14b6-4a06-b450-86086840117b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90032024-11-01T22:39:10.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00a5dd62-14b6-4a06-b450-86086840117b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90042024-11-01T22:39:10.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 00a5dd62-14b6-4a06-b450-86086840117b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90052024-11-01T22:39:11.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dec364b8-cfe8-4a74-982e-11bbebea8ab1 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90062024-11-01T22:39:11.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dec364b8-cfe8-4a74-982e-11bbebea8ab1 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90072024-11-01T22:39:11.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = dec364b8-cfe8-4a74-982e-11bbebea8ab1 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90082024-11-01T22:39:12.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bb7a50f1-9334-4e51-91c6-19629a730848 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90092024-11-01T22:39:12.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bb7a50f1-9334-4e51-91c6-19629a730848 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90102024-11-01T22:39:12.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = bb7a50f1-9334-4e51-91c6-19629a730848 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90112024-11-01T22:39:13.198ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = 216a8614-2da7-42f1-969e-7863389f9af8 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
90122024-11-01T22:39:13.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2aa608c0-aeb5-467f-b42a-896937cd400b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90132024-11-01T22:39:13.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2aa608c0-aeb5-467f-b42a-896937cd400b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90142024-11-01T22:39:13.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 2aa608c0-aeb5-467f-b42a-896937cd400b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90152024-11-01T22:39:14.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41e3e444-3310-4ef6-a6a6-0feb01c0df85 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90162024-11-01T22:39:14.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41e3e444-3310-4ef6-a6a6-0feb01c0df85 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90172024-11-01T22:39:14.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 41e3e444-3310-4ef6-a6a6-0feb01c0df85 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90182024-11-01T22:39:15.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8ba330d-2bb5-44ad-9ef2-99dceeff317b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90192024-11-01T22:39:15.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8ba330d-2bb5-44ad-9ef2-99dceeff317b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90202024-11-01T22:39:15.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c8ba330d-2bb5-44ad-9ef2-99dceeff317b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90212024-11-01T22:39:16.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f640ef0-4f5f-4079-9512-134751ea6458 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90222024-11-01T22:39:16.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f640ef0-4f5f-4079-9512-134751ea6458 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90232024-11-01T22:39:16.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 0f640ef0-4f5f-4079-9512-134751ea6458 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90242024-11-01T22:39:17.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d3d2f378-c9b1-4b19-86a4-6c06dac7c2e0 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90252024-11-01T22:39:17.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d3d2f378-c9b1-4b19-86a4-6c06dac7c2e0 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90262024-11-01T22:39:17.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d3d2f378-c9b1-4b19-86a4-6c06dac7c2e0 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90272024-11-01T22:39:18.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
90282024-11-01T22:39:18.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90292024-11-01T22:39:18.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
90302024-11-01T22:39:18.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90312024-11-01T22:39:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90322024-11-01T22:39:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90332024-11-01T22:39:18.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90342024-11-01T22:39:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90352024-11-01T22:39:18.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.744474ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90362024-11-01T22:39:18.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90372024-11-01T22:39:18.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90382024-11-01T22:39:18.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90392024-11-01T22:39:18.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90402024-11-01T22:39:18.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90412024-11-01T22:39:18.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90422024-11-01T22:39:18.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90432024-11-01T22:39:18.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
90442024-11-01T22:39:18.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90452024-11-01T22:39:18.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90462024-11-01T22:39:18.498ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
90472024-11-01T22:39:18.499ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.93452ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
90482024-11-01T22:39:18.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d0247835-c286-40d4-af22-7063a504d15a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90492024-11-01T22:39:18.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d0247835-c286-40d4-af22-7063a504d15a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90502024-11-01T22:39:18.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = d0247835-c286-40d4-af22-7063a504d15a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90512024-11-01T22:39:19.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 73a1a43f-6ffa-474c-a577-6b953e274738 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90522024-11-01T22:39:19.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 73a1a43f-6ffa-474c-a577-6b953e274738 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90532024-11-01T22:39:19.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 73a1a43f-6ffa-474c-a577-6b953e274738 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90542024-11-01T22:39:20.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 59680c57-bdf5-4d2c-8088-59f6c5db08c5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
90552024-11-01T22:39:20.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 59680c57-bdf5-4d2c-8088-59f6c5db08c5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
90562024-11-01T22:39:20.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36182 req_id = 59680c57-bdf5-4d2c-8088-59f6c5db08c5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
90572024-11-01T22:39:20.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7dc45d40-2c8b-4e1b-ae5d-0acc7bf911a7 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90582024-11-01T22:39:20.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7dc45d40-2c8b-4e1b-ae5d-0acc7bf911a7 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90592024-11-01T22:39:20.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 7dc45d40-2c8b-4e1b-ae5d-0acc7bf911a7 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90602024-11-01T22:39:21.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ad409278-ccbf-4ec3-8ec6-7016818c347b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90612024-11-01T22:39:21.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ad409278-ccbf-4ec3-8ec6-7016818c347b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90622024-11-01T22:39:21.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = ad409278-ccbf-4ec3-8ec6-7016818c347b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90632024-11-01T22:39:22.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4991077f-c55c-49c2-9f03-c9c3de770c67 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90642024-11-01T22:39:22.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4991077f-c55c-49c2-9f03-c9c3de770c67 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90652024-11-01T22:39:22.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 4991077f-c55c-49c2-9f03-c9c3de770c67 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90662024-11-01T22:39:23.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 85f3de08-2e38-49cf-93e0-210b5e2e6d15 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90672024-11-01T22:39:23.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 85f3de08-2e38-49cf-93e0-210b5e2e6d15 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90682024-11-01T22:39:23.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 85f3de08-2e38-49cf-93e0-210b5e2e6d15 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90692024-11-01T22:39:24.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ff4dd9b-5a94-47de-ba41-b9a5ca57a956 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90702024-11-01T22:39:24.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ff4dd9b-5a94-47de-ba41-b9a5ca57a956 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90712024-11-01T22:39:24.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 3ff4dd9b-5a94-47de-ba41-b9a5ca57a956 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90722024-11-01T22:39:25.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c49a572f-60f9-4e5a-bc67-dac15010b5bf roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90732024-11-01T22:39:25.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c49a572f-60f9-4e5a-bc67-dac15010b5bf resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90742024-11-01T22:39:25.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = c49a572f-60f9-4e5a-bc67-dac15010b5bf response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90752024-11-01T22:39:26.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a5ca2baf-753b-460e-99f0-df55e39ba339 roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90762024-11-01T22:39:26.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a5ca2baf-753b-460e-99f0-df55e39ba339 resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90772024-11-01T22:39:26.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = a5ca2baf-753b-460e-99f0-df55e39ba339 response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90782024-11-01T22:39:27.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c3e41a4-3146-47c1-817d-832c4a6d153a roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90792024-11-01T22:39:27.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c3e41a4-3146-47c1-817d-832c4a6d153a resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90802024-11-01T22:39:27.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 5c3e41a4-3146-47c1-817d-832c4a6d153a response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
90812024-11-01T22:39:28.196ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1456 local_addr = [fd00:1122:3344:101::b]:55601 method = GET remote_addr = [fd00:1122:3344:101::d]:51645 req_id = f647f020-aceb-4bdf-a210-8516e5ba3c64 response_code = 200 uri = /7e5351f7-5c9c-48ef-96e0-d88878eeb116
90822024-11-01T22:39:28.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
90832024-11-01T22:39:28.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90842024-11-01T22:39:28.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
90852024-11-01T22:39:28.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90862024-11-01T22:39:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90872024-11-01T22:39:28.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90882024-11-01T22:39:28.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90892024-11-01T22:39:28.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90902024-11-01T22:39:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90912024-11-01T22:39:28.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.470074ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90922024-11-01T22:39:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90932024-11-01T22:39:28.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90942024-11-01T22:39:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90952024-11-01T22:39:28.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90962024-11-01T22:39:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90972024-11-01T22:39:28.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90982024-11-01T22:39:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6, lookup_type: ById(ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6) } result = Ok(())
90992024-11-01T22:39:28.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91002024-11-01T22:39:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91012024-11-01T22:39:28.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 original_time_created = 2024-11-01 22:25:26.725759 UTC target_id = ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6 time_created = 2024-11-01 22:25:26.725759 UTC
91022024-11-01T22:39:28.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.651342ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ca3421d9-6ed2-4ff9-9937-5ca04bcedcf6","time_created":"2024-11-01T22:25:26.725759Z"}
91032024-11-01T22:39:28.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 947f41cf-0d3a-4397-84fd-87685f9fc7dc roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
91042024-11-01T22:39:28.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 947f41cf-0d3a-4397-84fd-87685f9fc7dc resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
91052024-11-01T22:39:28.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 947f41cf-0d3a-4397-84fd-87685f9fc7dc response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
91062024-11-01T22:39:29.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 86f6fb1a-0057-490a-ae2d-7bd47521882b roles = RoleSet { roles: {} } uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
91072024-11-01T22:39:29.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 86f6fb1a-0057-490a-ae2d-7bd47521882b resource = Database result = Ok(()) uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79
91082024-11-01T22:39:29.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37833 req_id = 86f6fb1a-0057-490a-ae2d-7bd47521882b response_code = 200 uri = /probes/8559b5a7-3301-45c6-8f36-6213ed147b79